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ABBREVIATIONS AND SYMBOLS 

Exact definitions of noise indices and scales for acoustical measurements can be found in general 
acoustical reference publications (e.g., Bennett and Pearsons, 1981). The units in which 
quantities are expressed are enclosed in square brackets. 

A; Annoyance with noise expressed by individual i 

B 0 Constant - (Extrapolated annoyance at 0 dB noise exposure) [Annoyance scale units] 
dB Decibel 

Bj^ Level-dependent change penalty for Wave w: Annoyance associated with a 1-decibel 
abrupt-change in noise exposure at the time of study wave w [Annoyance scale units] 

B do Level-dependent change penalty at time= 0: Extrapolated annoyance associated with a 1- 
decibel abrupt-change in noise exposure at time T=0 (day of the change) [Annoyance scale 
units] 

B l Annoyance associated with a 1 -decibel difference in steady-state noise exposure (positive 
values indicate that annoyance increases with noise level) [Annoyance scale units] 

Bpanel Panel effect: Annoyance at the time of follow-up interviews that is associated with being a 
member of a study panel. 

Rj. Decay exponent: A multiplicative constant in an exponent for e that represents the 

reduction in annoyance associated with the time (expressed in days) that has elapsed since 
an abrupt change in noise exposure 

B Ww Noise change novelty penalty for wave w: Annoyance associated with the novelty of a 
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change in noise exposure in study wave w 

C. A dummy variable that is 1 for individual i after experiencing a change in noise exposure 
and 0 otherwise 

dBEAU Decibel Equivalent Units. This expresses annoyance effects in terms of the number 
of decibels that would create an equivalent effect by dividing an effect (expressed 
in annoyance units) by the amount of increase in annoyance (expressed in 
annoyance units) that is associated with a one-decibel increase in steady-state noise 
exposure. 

DNL Day-night Average Sound Level [dB(A)] 

D ; The abrupt change in noise exposure for individual i [dB] 
e The base for the natural logarithm (2.7183) 

L; Noise exposure for individual i [dB] 

Equivalent Continuous Sound Level (Average Sound Level) for 24 hours [dB(A)] 

La,, Day-night Average Sound Level (DNL) [dB(A)] 

PANEL- A dummy variable that is 1 for an individual who has been previously interviewed 
in a panel survey and 0 otherwise 

PSU Primary Sampling Unit: The sampling unit at the first stage of a multi-stage sample 
(usually the study area in a noise survey) 

T. Time elapsed since the abrupt change in noise exposure for individual i [days] 

U Combined effect of response errors from the group, person and interview [Annoyance 
scale units] 

U Community Group effect: The effect of a community location on annoyance (normally 
distributed with mean of U g =0) [Annoyance scale units] 

U Persistent Person effect: The effect of the person (those effects that are constant for the 

P period of the study) on annoyance within a community (normally distributed with mean of 

U =0) [Annoyance scale units] 

U- Specific interview effect: The effect of the conditions at the time of the interview on 
annoyance within a person and group (normally distributed with mean of U— 0) 

[Annoyance scale units] 

V 0 Noise change novelty penalty at time=0: Extrapolated novelty effect (increment in 

annoyance) for an abrupt change in exposure on the day of a change (T=0) [Annoyance 
scale units] 

W wi A dummy variable that is 1 for individual i in wave w and 0 otherwise 
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EXECUTIVE SUMMARY 


Previous studies of airport community residents’ reactions to long-term, aircraft noise 
environments have provided data for widely-accepted environmental noise planning tools. 
However, studies of residents’ reactions to new, abrupt changes in aircraft noise environments 
have not provided a firm basis for planning. A previous NASA report found that studies of 
reactions to changed noise environments have been difficult to execute with sufficient precision to 
be useful for policy purposes. An extensive search for all previous noise-change study data sets 
that was conducted for this report discovered that none of the available, original data sets provide 
a satisfactory basis for new analyses of the effects of an abrupt change in aircraft noise exposure. 
This report presents a plan for a new study of reactions to changes in aircraft noise and presents a 
study design evaluation tool that can be used to evaluate candidate study sites. 

A study of residents’ reactions to abrupt changes in aircraft noise exposure is proposed that has 
the statistical goal of being sufficiently precise to detect any overreaction to a changed noise 
environment that is the equivalent of a five-decibel difference in steady-state noise exposure. 

The twenty-seven elements of the proposed study design include social and acoustical surveys at 
the same airports before and after changes in noise exposure. 

New analyses of the original data from previous community reaction surveys provide the basis for 
the study plans. New analyses of data on seasonal effects determined that residents’ reactions to 
noise are influenced by the season of the year and thus lead to the recommendation that the 
surveys before and after a change in noise exposure be conducted at the same time of year. 
Analyses of the original data from six previous surveys with panel designs determined that re- 
interviewing the same respondents at a one-year interval would increase the precision of a survey 
without biasing respondents’ answers. 

Questionnaires for a noise change study have been developed and pretested in communities that 
experienced or expected to experience abrupt changes in aircraft noise exposure. A program for 
monitoring publicity during a noise-change period was developed based on evaluations around 
three airports. 

A model for reactions to changes in aircraft noise is proposed. The primary variables are the pre- 
change noise environment, the extent of change in the noise environment, and the length of time 
that has elapsed since the change. An analysis has been conducted of previous surveys that 
demonstrates a method for estimating the parameters in the model. 

A study simulation computer program for evaluating alternative study plans for new abrupt 
change studies has been developed. This study evaluation tool predicts the precision of estimates 
of two parameters in a noise change model and measures the effects of errors in noise 
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measurements on the estimates of parameters in the noise change model. The human response 
parameters that are input to the evaluation tool come from an analysis of 21 previous noise 
surveys. 

An exhaustive search was conducted to locate all satisfactory sites for a noise change study within 
the United States in 1998. On the basis of simple criteria all but two sites were eliminated as 
possible candidates. The data on the population distribution and expected noise exposures was 
analyzed for these two sites using the study evaluation tool. The tool determined that one site 
could not provide sufficiently precise estimates to meet the study design criterion. Although the 
precision expected from the second site was sufficient to meet the study goals, the change in 
operations at the airport was scheduled to occur gradually over a one-year period and thus was 
not suitable for a study of reactions to abrupt changes in aircraft noise. 

Although no suitable site was found for a study in 1998, the study plans, questionnaire, and 
survey evaluation tool can be used to support a study in the future. 
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1.0 INTRODUCTION 


Residents’ reactions to the long-term noise environments near their dwellings have been widely 
studied. Several hundred studies have been conducted in which residents’ reactions, measured in 
social surveys, have been related to the long-term noise environments, as measured in acoustical 
surveys and noise estimation programs (Fields, 1991). Estimates of noise reactions under these 
settled environmental conditions are now widely available for environmental noise planning 
purposes (Schultz, 1978; Fidell, Barber, and Schultz, 1991). However, very little satisfactory 
information is available about reactions to changing noise environments. As a result there is no 
widely-accepted basis for predicting the reactions of residents to recently changed noise 
environments. 

Although more than 23 studies have been conducted of reactions to recently changed noise 
environments, a review has found that these studies have not provided solid, consistent evidence 
about reactions to such changing environments (Horonjeff and Robert, 1997). Many of the 
problems in generating strong evidence can be traced to weaknesses in the studies’ designs and to 
the choice of fundamentally unsuitable study locations. This report presents methods for avoiding 
or mitigating such problems. 

The purpose of the present report is to develop and demonstrate study design and site selection 
principles for studies that will satisfactorily estimate the impact of changes in noise exposure on 
residents’ reactions to noise. The report seeks to achieve this goal by describing the elements of a 
strong noise-change study design demonstrating the use of suitable analysis techniques on existing 
data sets and developing and using several elements to select and evaluate study sites. 

Knowledge about reactions to changed noise environments is of practical importance. 

Information about reactions to changed noise environments is needed for planning for changed 
airport operations. Many airports follow guidelines or regulations that define acceptable noise 
exposures on the basis of long-term noise exposure. Such guidelines or regulations either 
implicitly or explicitly posit a dose/response relationship between residents' reactions and their 
noise exposures. The primary purpose of this project is to develop studies that can determine 
whether that "steady/state" dose/response model also applies to the prediction of residents' 
reactions after an abrupt change in noise exposure or whether a different model is needed to 
describe reactions after an abrupt change in noise exposure. The pragmatic question that 
responsible authorities need answered is: "Can authorities use their current, accepted 
dose/response curve for planning that involves new noise exposures, or is some adjustment 
needed when there is a change in noise exposure?" 


- 1 - 


1.1 Definition of the noise-change issue 

The purpose of the noise/change studies by this report is to estimate the incremental change in 
residents’ annoyance to a noise source that is caused by an abrupt change in noise exposure. This 
is labeled an “abrupt change effect.” The primary focus is on the abrupt change effect in an 
airport environment when the change represents an increase in noise exposure. The generality of 
this report’s results are discussed in this section. 

The proposed study designs concern abrupt changes in noise exposure in which a transition to a 
new noise environment is completed within a few days or weeks after which a new steady-state 
noise environment is established. The underlying study design principles could be modified to 
encompass changes that occur over a long period of perhaps a year. However, a different 
approach would be needed for the more general case in which there is a slow incremental increase 
in transportation noise over many years due to slowly increasing volumes of traffic. 

The responses to noise that are studied are residents’ attitudes, feelings and, to a lesser extent, 
behaviors as measured in social surveys. Although there are frequent references to the term 
“annoyance,” the most widely studied reaction to noise, the study principles should also be 
applicable to many other types of attitudes, feelings or behaviors that are related to noise. 

In this report no attempt is made to explain the highly visible, public reactions to planned changes 
in noise environments that occur before the environment changes. These are types of reactions 
that are, of course, of concern to airport planners. Such public reactions are often seen as 
evidence that changed noise environments will generate unusually strong annoyance reactions 
once a change in noise environments is introduced. The purpose of this report is to examine those 
post-change, private annoyance reactions to newly changed noise environments, not the visible, 
public reactions to plans for changes. 

The abrupt change effect is a measure of a change in the dose-response relationship. A noise 
environment can change and individuals can recognize that change and adjust their reactions to 
the new environment without any abrupt change effect being present. The abrupt change effect is 
the change in noise annoyance that is in addition to the amount of annoyance that is predicted to a 
steady-state noise of the same noise level. The term “steady-state” noise refers to a noise 
environment in which the pattern of noise exposure has not been subject to substantial changes 
over a long period of several years. In most large airport environments such steady-state 
conditions include many sites with substantial day-to-day variations in noise exposure. 

Although this report focuses on increases in noise from aircraft, the proposed plans should be 
equally applicable for studies of reductions in noise and, with minor modifications, for studies of 
noise from road traffic, railways and other noise sources. The primary differences in plans for 
different noise sources concern the physical noise measurement programs. 
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1.2 Special design problems for noise change studies 

Noise change studies are subject to three major special problems in addition to the difficulties in 
annoyance measurement, noise measurement, and sample selection that are common to most 
community noise studies. These problems have received special attention in the development of 
the study plans in this report. 

Problem #1 : Identifying study sites with large changes in noise environments: Good estimates of 
the effects of changes in noise environments require that study airports include some 
environments that have experienced large changes in noise exposures. Several studies of changes 
in noise environments have been conducted when the planned changes in exposure were too small 
to have a reasonable probability of being detected (Fidell, Horonjeff, Mills, Baldwin, Teffeteller, 
and Pearsons, 1985; Fidell, Mills, Teffeteller, and Pearsons, 1982). At least one study was 
conducted when an increase of only ten percent in traffic was expected (Gjestland Liasjp, 
Gran0ien, and Fields: 1990). It is important to realize that many previous steady-state noise 
studies support the assumption (implicit in LAeq) that a doubling in the number of noise events 
will be the equivalent of only a barely noticeable, three-decibel increase in individual noise event 
levels. Areas with small noise changes have been used as study sites because the presence of 
considerable controversy during planning stages was taken as evidence that there could be 
substantial effects on individuals’ annoyance reactions after the changes. From these past 
experiences, however, it appears that almost nothing can be learned about the effects of changes 
in airport operations unless those changes generate considerable changes in noise environments. 
A seeming contradictory conclusion has been reached by one road traffic study that found that a 
small reduction in road traffic noise generated a large reduction in annoyance (Kastka, 1980; 
Kastka, 1981). In this case, however, the reduction in road traffic noise was part of a highly 
visible set of traffic restrictions that affected other aspects of the local road traffic environment. 


Problem #?• Designing study plans that can accommodate uncert ain noise environment 
predictions: Plans for changes in airport operations provide the only available basis for predicting 
the aircraft noise environment that will be present at the time of a study. Reviews of previous 
noise-change studies and reviews of the implementation of airport operation plans have, however, 
revealed that these predictions are often incorrect in the following ways: 1) the timing of the 
operational change is revised, 2) the type of operational change is revised during one of the 
planning cycles before an airport opens, 3) the assumptions about types of aircraft or the amount 
of growth in traffic are incorrect, and 4) experience gained while implementing the operational 
changes leads to additional unexpected alterations. These incorrect predictions mean that aircraft 
noise exposures that formed the basis for the study design may not be achieved and that the 
aircraft operational changes that were expected to generate a single, large, abrupt change in 
exposure may, instead, generate a series of variably sized changes in exposures that affect 
different parts of the airport study environment differently. 

Problem #3: Measuring and controlling for the effects of c orrelated variables: The most serious 
problem facing even the best-designed noise change study is the possibility that other variables 
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that are spatially or temporally correlated with the noise change will distort the estimate of the 
effects of the change in noise environment. Both of the following two alternative strategies for 
studying noise change face this problem. Studies that contrast the after-change reactions at one 
airport with the steady state reactions at other airports can not separate the unique effects of one 
airport from the effects of the change in noise environments. On the other hand, studies that 
compare the reactions before and after a change at a single airport must consider the possibility 
that the comparison is affected by any of a large number of differences between the study methods 
or other community conditions before and after the change. This report recommends the second 
strategy, repeated measurements at a study airport. Attempts are made to control for the effects 
of correlated variables by using exactly the same study methods in the before and after study 
phases, by monitoring community conditions during the survey period, and by interviewing the 
same respondents. Nonetheless, all variables can not be controlled and correlated variables 
continue to pose a serious threat to a study of reactions to changes in noise environments. 
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2.0 CONCEPTUAL CONTEXT: THEORIES AND TESTING THEORIES IN A NOISE 
CHANGE STUDY 


The design and analysis of a study of reactions to changes in noise levels is guided by an overall 
conceptual model of the factors that affect residents’ reactions to environmental noise in general 
and to changes in noise exposure in particular. This chapter discusses possible theoretical bases 
for expecting an abrupt change effect, describes a model of reactions to abrupt change and lists 
variables that should be measured and analyzed as part of an abrupt change analysis. The primary 
emphasis of this chapter is on identifying the important variables. This discussion divides those 
variables into variables that are integral parts of an abrupt change model and those that need to be 
considered for their theoretical value or because they could confound the estimates of the effects 
of the primary model variables. Because there are not well-developed theories about the 
relationships between these variables, relatively little attention is directed at theories about 
complex forms of relationships. 

2.1 Theoretical bases for expecting an abrupt change effect 

Previous reports about changes in noise exposure have not offered an explicit theoretical basis for 
expecting that residents’ reactions to recently changed, daily noise environments should be any 
different from those to steady-state noise environments. It is obvious that reactions will differ on 
the very first occasion upon which a new noise is heard. However, it is not obvious that such a 
reaction should persist. It would be useful to have one or more theoretical bases for expecting 
that residents’ reactions after even a short time has elapsed (perhaps one week) should be any 
different from those of residents who had been exposed to the same noise in their neighborhood 
for all of their period of residence. 

This section lists seven theories that could explain an abrupt change effect. No attempt is made to 
develop or evaluate these theories. This section also identifies aspects of the study design or 
questionnaire that are designed to provide some insight into the validity of these theories. The 
primary purpose of the questionnaire is not, however, to test these theories, but rather to 
determine whether an abrupt change effect, whatever the explanation, is present. 

In considering the theories, notice is taken of the fact that a previous meta-analysis of 
demographic variables showed that reactions of new residents to the steady-state noise are not 
different from those of longer-term residents (Fields, 1993). The simple exposure to a new type 
of noise environment is obviously not sufficient to generate a difference in reactions. 

Theory #1: Analogy to short-term attention effects: It is obvious that humans have their attention 
drawn to new, unusual aspects of their environment. It is frequently observed that visitors in a 
neighborhood are aware of, or even startled by, the first loud aircraft noise event they hear in a 
neighborhood, where as a resident may show no signs of even noticing the event. By 
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extrapolation, it might be expected that “newness” would persist so that people who had 
experienced a type of aircraft event for one week could have a different reaction than those who 
had experienced the same type of event for all of the time they lived in the neighborhood. It is not 
clear, however, that there is a strong theoretical basis for such an extrapolation. It seems possible 
that the initial, possibly physiologically-based, startle reactions to a new aspect of the environment 
may disappear after a very small number of repetitions of the event. The apparent attraction to 
such an extrapolation may owe more to the linguistic ambiguity of terms such as “recent” or 
“new” (“new” things can be one second or ten years old) than to a careful consideration of the 
mechanisms involved. 

Theory #2: Baseline for noise evaluations : Residents who experience a change to a new noise 
environment may give that new environment special attention because their baseline for evaluating 
the noise is their previously-experienced residential noise environment. Residents without such an 
obvious baseline may, on the other hand, depend more on their personal, day-to-day experiences 
in evaluating the importance of particular noise events. 

Theory #3: Lack of adaptive mechanisms: Residents with long-term exposures may have 
developed adaptive mechanisms to accommodate the noise exposure. They may routinely stop 
talking during noise events, adjust the television volume to avoid interferences from noise or have 
adapted the usage of their house to avoid noise exposure. Residents who are introduced to a 
rapid change in exposure may not have adopted such mechanisms and thus may experience more 
activity interference than do residents with long-term exposure. People who move into a high 
noise area might be more likely to more quickly adopt such mechanisms as a normal part of the 
process of developing new patterns of living in a new surrounding. For example, new residents 
might take noise level into account in determining the usage of rooms. Residents with an abrupt 
change, however, will have already established room-usage patterns that did not account for noise 
levels. These patterns may be so firmly established by the time a noise change is introduced that 
the patterns will not be revised to accommodate the change in noise levels. The questionnaire 
may provide some insight into this theory through questions about the extent to which noise 
interferes with activities (Q.16). 

Theory #3: Realization that noise can be controlled: Beliefs about the “preventability” of noise 
have been found to be consistently related to noise annoyance (Fields, 1993). When the noise is 
changed, residents who might otherwise accept their noise exposure as inevitable may realize that 
noise exposure can be controlled by human actions. The questionnaire explores this theory with a 
question about whether noise could be reduced by pilots, airline companies, airport officials, or 
local governments. (Q.20) 

Theory #4: Difference between accepting noise when moving to a new home and when the 
environment changes: People may have selected their residence on the basis of an expected noise 
environment. If they feel that the imposition of a new, changed noise exposure is an unfair 
departure from the conditions that they originally, implicitly accepted, they may be more annoyed 
by the new noise environment. This theory is explored with questions that ask respondents to 
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recall their expectations, if any, about the aircraft noise at the time that they moved to their 
neighborhood (Q.22). 

The gap between the implicitly accepted noise environment and a totally unanticipated new 
environment noise is a major focus for controversy about changing noise environments. It should 
be noted, however, that the fairness issue about values (Is it fair to change the noise?) is distinct 
from the scientific question (Will annoyance with the noise be any different?). 

Theory #5: Exposure of sensitive people to high noise: If noise-sensitive people usually avoid or 
move out of high noise areas, then the shift in noise exposure may result in an unusual condition 
in which relatively sensitive people are exposed to high noise levels. This theory is partially tested 
with questions about residents’ sensitivities to noise (Q.33, Q.34). A review of published 
evidence suggests that such an effect may not be present because previous studies have not found 
a relationship between general sensitivity to noise and environmental noise exposure (Fields, 

1992). 

Theory #6: Heightened reactions through publicity: Changes in airport noise exposure are often 
accompanied by heightened publicity surrounding the planning for the change and the 
implementation of any changes in operations. In addition, local media sources may include 
articles about the views of those opposing such changes and about the effects of noise. The 
heightened publicity about noise exposure effects might make residents more aware of the effects 
of noise than would be expected in a steady-state situation. Information to aid in evaluating this 
theory is gathered in the questionnaire with questions about exposure to the media (Q.41, Q.42, 
Q.43), awareness about a planned change (Q.23, Q.24), awareness of an implemented change 
(Q.12, Q.13, Q.14), and information gained from the media about the change (Q.13.C, Q.13.e). 
Plans for the proposed study also specify that information about the extent of publicity be 
gathered through an independent examination of publicity that appears in local media (See 
Chapter 4). 

Theory #7: Resentment concerning the decision-making process: The change in exposure may 
have occurred after bitter disputes during the planning process for the change. Such resentment 
and residual bitterness might lead some residents to be more annoyed by the noise than otherwise. 
This knowledge might be partially disseminated through media sources. Unlike the previous 
theory, however, the heightened annoyance does not derive from a change in the awareness of 
noise itself, but rather from feelings about the process that generated that change. The 
questionnaire explores this issue with a question about the fairness of the decision process 
(Q.13.f). An independent examination of the community and the context of the change will 
describe the public controversy and associated issues that could be related to the noise change 
issues (See Chapter 4). 

2.2 Variables to be measured in an abrupt change study 

This section describes 17 groups of variables (lettered from “a” to n ) that are recommended for 


- 7 - 


testing models and theories for abrupt change studies. The variables are loosely grouped under 
three headings. Some of the material in this section was discussed in the earlier NASA 
contractor’s report on noise change studies (Horonjeff and Robert, 1997). The reader is referred 
to that report for a more detailed discussion of some issues, including a detailed discussion of one 
possible form of the relationship between annoyance and aircraft noise exposure (Horonjeff and 
Robert, 1997; 90). 


2.2.1 Core variables and assumptions for an abrupt change model 

The primary purpose of the present study is to measure and predict the relationship between a 
reaction to aircraft noise and two factors: 1) the noise level to which a resident is exposed and 2) 
the changes in noise exposure which the resident has experienced. For simply describing the 
magnitude of the change this report focuses on four variables. Each of these variables is briefly 
defined and any of their characteristics that relate to noise change studies are described. The 
symbol representing each variable in discussions of the abrupt change model appears in square 
brackets. 

a. Response: A resident’s reaction to noise. [AJ 

The residents’ reactions to the current noise level are measured in a questionnaire 
(Q.8.iv, Q.ll, Q.16, Q.30, Q.31, Q.38, Q39A, Q39B). A detailed discussion of 
the rationale for the simple annoyance response measure used in this study is given 
in the research plan. 

b. Noise exposure: The current noise exposure at the dwelling. [LJ 

The program to estimate that exposure is described in the research plan. The 
primary emphasis is on the components of the Day-Night Noise Level (DNL). 

c. Noise change: The change in noise exposure. [DJ 

The program for estimating the pre-change noise environment is described in the 
research plan. A primary, but only partially resolved, issue concerns the aspects of 
the noise exposure that should be measured other than the equivalent noise levels. 
The previous report on this project discusses the issue in some detail (Horonjeff 
and Robert, 1997). The primary problem for aircraft noise is that the considerable 
variability in flight-to-flight and day-to-day exposures in both the pre-change and 
post -change “steady state” environments may mean that only a more complex 
noise metric could measure those characteristics of an aircraft noise environment 
that respondents will notice. 

d. Elapsed time: The time elapsed between the time of the exposure and the measure 
of respondents’ reactions. [TJ 

Although the time between various events can be easily measured, the 
representation of the beginning of the period can be uncertain if the change 
occurred over a transition period and if that transition period included several 
different types of changes. An additional complication concerns the representation 
of elapsed time in an abrupt change model. This report accepts a decay model in 
which the maximum abrupt change effect has been achieved before the time of the 
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first observation (made at least a week after a change) and decays until it 
disappears at the time when the dose/response relationship is the same as that 
observed under the previous steady-state conditions. The report ignores the 
possibility that it might take a longer time for any overreaction to the change to be 
expressed. Even given this decay assumption, it is not clear whether the decay 
should be assumed to be linear, exponential, or of some other form with respect to 
elapsed time. These issues are left largely unexplored, partly because the presence 
of seasonal effects and requirement for a large number of interviews would make it 
difficult to estimate a decay function with any accuracy. 


At least three other variables are of importance for studies of noise change generally, but are 
assumed to be constant for this model: 

e. Perceived permanence: Whether or not the change is perceived to be permanent. 
This report is only concerned with changes that are expected to be permanent. 
Some previous studies have focused on temporary changes caused by such features 
as temporary runway closings due to repairs (Fidell, Horonjeff, Mills, Baldwin, 
Teffeteller and Pearsons, 1985) or the presence of short-term military exercises 
(Gjestland, Liasj0, and Gran0ien, 1995). Reactions to noise environments that are 
perceived to be transitory could be different from reactions to noises that residents 
assume will become a part of their neighborhood environment. 

f. Length of transition: The time elapsed from the pre-change steady state to a new 
steady-state exposure. 

This report is directed at abrupt changes in noise exposure. It is assumed that 
there is a transition from one persistent state to another persistent state, but that 
the transition period is restricted to a few days or weeks. Reactions to gradual 
changes over long periods of time might be quite different. 

g. Geographical extent: The size of the area over which the change extends. 

This report only considers changes that affect both indoor and outdoor exposure in 
the respondent’s neighborhood. Quite different mechanisms may be involved in 
changes that occur only indoors (for example, from home insulation) or only in the 
dwelling’s immediate surroundings (for example, from the construction of barriers 
for road traffic noise). 


2.2.2 Explanatory variables with special significance for noise change model estimates 

With respect to the general noise-change issue, the following variables might be expected to 
directly affect estimates of the noise-change effect 

h. Acoustical characteristics of change: 

As noted above, aspects of the noise in addition to the total energy as represented 
in DNL could affect reactions to changes in noise and even whether the change in 
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noise is perceived at all. Recommendations for measuring or documenting such 
changes are given in the study outline when the noise-measurement program is 
described. The questionnaire may provide some additional insight when 
respondents are asked about their perceptions of changes on the noisiest days 
(Q.32). 

i. Time at home: The amount of time the respondent has spent at home since the 
change. 

An examination of published studies indicates that the amount of time people 
spend at home does not affect reactions to steady-state noise environments (Fields, 
1993). However it is possible that the time at home could affect perceptions of 
short-term changing noise environments. People who are not at home may not 
have experienced the changes or not have accumulated enough experience with the 
new environments to judge whether there has been an overall shift in exposure. 

The time spent at home on weekdays is asked about in the questionnaire (Q.45). 

j. Season of interview : The time of year at which the interview is conducted. 

The evidence reviewed in Appendix E suggests that reactions to noise do vary with 
the season. A model for seasonal effects is included in that appendix. It is 
assumed that seasonal effects can not be adequately modeled or estimated in a 
noise change project and thus that the only solution is to follow procedures that 
control for seasonal effects through the timing of interviews. 

k. Repeated interviews: The extent to which the respondent has been previously 
interviewed. 

The evidence reviewed in Appendix D indicates that a small number of widely- 
spaced interviews with the same respondents do not bias the responses to noise. 
The available data were not sufficiently strong to determine or model any effects 
that might be present for closely-spaced interviews or a large number of interviews 
on the same subject. 

2.2.3 Explanatory variables of general significance 

The dependent variable in any analysis of noise change is the reaction to noise. As a result any 
variable that affects reactions to noise could be of importance for a noise change study. 

Controlling for variables that are not correlated with noise change is useful because they could, 
theoretically, reduce some of the unexplained variance and result in more precise estimates of the 
elements in a noise/change model. The identification of variables that are correlated with changes 
in noise exposure is of great importance since their presence could bias estimates of the abrupt 
change effect. The remainder of this section lists a large number of variables that deserve some 
attention in a noise-change study. 

l. Noise-exposure representation: Although DNL and 24-hour LAeq are widely 
accepted as environmental noise metrics, debate continues about whether they 
correctly represent the various aspects of noise exposure. Estimates of noise- 
change effects will be biased to the extent that any incorrectly-represented factors 
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are not related to LAeq. The effects of such variables can almost certainly not be 
determined in a noise-change study, but the measurement and analysis of their 
presence would make it possible to determine whether misspecification of the 
noise-exposure model could possibly account for the size of an abrupt change 
effect. The effort expended on measuring these variables needs to be guided by 
the size of any expected correlated changes and the expense of monitoring them. 
The most often mentioned variables include the following: 

# Number of noise events 

# Duration of individual noise events 

# Peak levels of noise events 

# Time-of-day of noise exposure 

# Other temporal patterns of noise exposure and noise relief (e.g. rest 
periods) 

# Ambient noise levels 

# Noise-event onset rates 
Spectral frequency profiles 


m. Associated aircraft impacts: Aircraft operations affect other aspects of the local 
environment. The changes in operations that generate changes in noise exposure 
can often have correlated effects on other aspects of the environment that may, in 
turn, affect reported reactions to aircraft noise. These effects tend to be highly 
correlated with noise level and to thus be difficult or impossible to evaluate in a 
single noise-change study. If the variables are almost always correlated with noise 
level, then understanding their role may be of little practical importance even 
though they are of considerable theoretical interest. These variables are listed 
next, along with the question number of questionnaire items that attempt to 
monitor respondents’ perceptions of their impact: 

• Odor from aircraft (Perception of “fumes or smells” in Q.17.i) 

• Dirt from aircraft (Perception of “dust or dirt” in Q.17.ii) 

# Lights from aircraft (Perception of “lights” in Q.17.iii) 

# Noise from aircraft on the ground (Reactions to aircraft when they are 
“sitting on the ground running their engines or moving around the 
airport”in Q.17.iv ) 

# Fear of crashes near residences (Q.18) 

• Over-head flight paths (Perception of frequency of over-head flights, Q.19) 

n. Individual and community characteristics: A large number of characteristics of 
respondents have been considered as possible factors that impact reactions to 
noise. Some demographic variables are routinely controlled because their 
distribution is likely to be uniform over different communities (for example 
gender). Demographic characteristics that have been examined in the past have 
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been found to either have no effect or to have only a small effect on annoyance 
(Fields 1993, Miedema and Vos, 1999) The reliance on a repeated interview 
design that is described below should serve to control many variables’ effects. A 
serious threat to estimates of the abrupt change effect occurs if there are random 
differences in the impact of noise in different communities. If these differences 
affect the ways that communities react to noise, estimates of the abrupt change 
effect could be biased. If the community differences affect only the reaction to 
aircraft noise generally, the precision of study estimates could be affected. The 
increased variability in the study estimates must be estimated with analysis 
techniques that account for the lack of independence of the respondents’ answers 
in geographically concentrated areas. 

The following demographic variables are measured in the recommended questionnaire: 
Gender (Q.5) 

Household composition (Q.5) 

Length of residence (Q.21) 

Length of interview 
Age (Q.47) 

Home ownership (Q.48) 

Amount of time away from home (Q.45) 

Education level (Q.51) 

Employment associated with the airport: (Q.43) 

Relationship to military services (Q.46) 

The attitudinal variables include the following: 

General noise sensitivity (Q.33, Q.34) 

Level of concern with environmental issues (Q.40) 

Fear of aircraft crashes (Q.18) 

Perception that aircraft noise can be prevented or controlled (Q.20) 

Other personal variables include: 

Attenuation through double-glazed windows (Q.28) 

Plans for moving from area (Q.49) 

Discussion of questionnaire with neighbors (Q.50) 

2.3 Abrupt change response model 

In the preceding section, four “core” variables for an abrupt change model were identified. The 
basic abrupt change model used in this report therefore models the relationship between an 
individual’s noise annoyance(Aj) and three variables, the individual’s noise exposure (L-,), the 
amount of the abrupt change in noise exposure (D,) and the time elapsed since that change (Tj). 
The discussion of these variables identified uncertainties about how these variables would be 
related in a response model. In this section, one model is proposed that could serve as a baseline 
for evaluating other models. 
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As a baseline model, the relationship between the four core variables is posited to be the 
following: 


Aj= B 0 + Bl'L-, 


V 0 * 


(Bt-to . Q + B do » c (B t,t ° «D, + U 


gp> 


where: 


Aj Annoyance with noise expressed by individual i 
B 0 Constant - (Extrapolated annoyance at 0 dB noise exposure) 

Bp,, Extrapolated annoyance associated with a 1 -decibel abrupt-change in noise exposure at 

time T=0 (day of the change) . 

B l Annoyance associated with a 1 -decibel difference in steady-state noise exposure (positive 

values indicate that annoyance increases with noise level) 

B t A multiplicative constant in an exponent for e that represents the reduction in annoyance 
associated with the time (expressed in days) that has elapsed since an abrupt change in 
noise exposure 

C; A dummy variable that is 1 for individual i after experiencing a change in noise exposure 
and 0 otherwise 

D; The abrupt change in noise exposure for individual i [dB] 
e ' The base for the natural logarithm (2.7183) 

Lj Noise exposure for individual i [dB] 

t! Time elapsed since the abrupt change in noise exposure for individual i [days] 

U ; Combined effect of response errors from the group, person, and interview 

V : Extrapolated novelty effect (increment in annoyance) for an abrupt change in exposure on 

the day of a change (T=0) 


Several aspects of this model should be noted. Annoyance is assumed to be linearly related to the 
current noise level. Annoyance after a change is a sum of the annoyance predicted in the steady 
state situation and penalty increments that decay with time. 


Two types of penalty increments are included in the model. The first penalty increment [V 0 » e 
to i js labeled the novelty effect. This is an increment that is associated with the novel experience 
of being near an airport after the noise environment has changed. The term V 0 in the model is the 
extrapolated value of that increment in annoyance on the first day of a change (T=0). The value 
of the expression V 0 * * Ti) is independent of the amount of change experienced but depends 

upon the amount of time that has elapsed since the abrupt change. This part of the abrupt change 
effect is the same for individuals experiencing a20-decibel increase, 1-decibel increase or a 20- 
decibel decrease. The second penalty increment varies with the size and direction of the change in 
noise exposure. Each decibel increase in noise exposure is assumed to add an additional 
increment to annoyance of B D0 * e^ T ’ T ’ ; at time Tj. 


The novelty effect can be conceptualized in several different ways that require different definitions 
of “C,” the binary change indicator. For aircraft noise in the analyses in this report, pre-change 
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respondents are assigned a value of 0 and all post change respondents are assigned a value of 1 
whether or not the noise level actually changes in a respondent’s location. This can be justified 
either on the basis that a publicity effect would generate a change in reactions or on the 
assumption that even though there may not have been a change in noise exposure at a location, 
other changes in aircraft operations might be noticed at that location. An alternative 
conceptualization is to only assign a value of C=1 to respondents who actually experience a 
change in exposure. Still another issue concerns the effects of an increase or decrease in 
exposure. This model assumes that the novelty effect is the same in either instance on the theory 
that greater awareness of noise will increase reactions. An alternative conceptualization that 
should be tested in analyses is that the novelty effect is different for decreases and increases in 
exposure. 

As previously noted, this decay function predicts that the decay in response is most rapid 
immediately after the change and gradually reduces at an ever decreasing rate. The value of B T is 
expected to always be negative. As a result the expression [e^ r ,T?) ] is the proportion of the 
original response increment (from time T=0) that persists until the interview at the specified time 
(Tj) after the change in exposure. Figure 1 shows the values of this portion of the decay term for 
a two-year, post-change period (0 to 730 days) for seven values of B T . At the extremes, a value 
ofB^-1.000 implies that the effect of a change almost disappears in 60 days, while a value of 
Br= -0.001 implies that the initial effect is retained at about 70 percent of its original value in 365 
days and is still present after 730 days when it still retains 50 percent of its original value. 

The unexplained variation in annoyance is represented by a single error term in the model above 
[ U «pJ- This s i n g ,e te ™i can, however, be divided into the following three components all of which 
are assumed to be normally distributed with a mean of zero: 

U g Community Group Effect: The effect of a community location on annoyance 
U p Persistent Person Effect: The effect of the person (those effects that are constant for the 
period of the study) on annoyance within a community 
U; Specific Interview Effect: The effect of the conditions at the time of the interview on 
annoyance within a person and group 

The community group effect (U^ represents the substantial variation between groups of 
respondents than can not be explained by their measured noise exposure or by random differences 
in individuals’ responses. The analyses in Appendix G estimate that the standard deviation of this 
effect is the equivalent of approximately a seven-decibel difference in noise exposure. For the 
purposes of the analyses in this report the community group is considered to be the Primary 
Sampling Unit (PSU), the unit that is sampled at the first stage of a sample design. For most 
noise studies this is a study area that shares a single assigned noise exposure. A group effect 
could arise from the interaction between neighbors, publicity in local areas, unmeasured 
differences between noise exposures in different areas or to any other differences between areas 
that affect responses 
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The person effect (UJ and interview effect (U^ are evaluated separately for surveys with a panel 
design in which the same respondents are repeatedly interviewed. The person effect represents 
the consistency in each individual’s response that persists between the repeated interviews. This 
is a measure of between-individual, but within-group, differences. Most discussions about 
individual differences in reactions to noise refer to such presumed enduring differences between 
individuals in their demographic or attitudinal characteristics. 

The specific interview effect (U^ represents the remaining unexplained variation in reactions. This 
could be a result of wide range of factors including effects of respondents’ moods on particular 
days, recent experiences with noise exposure, errors in understanding questions, or interviewer 

effects. 



Figure 1 Slopes of the decay function over a two-year period for seven values of Rj. 
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The model presented in this section should be only the starting point for any actual analysis of 
survey data. With respect to noise-change theories, one of the most important tests would be to 
determine whether both the novelty effect and the level-dependent change penalty are needed. 
The model is discussed further in Chapter 5 where an analysis of existing data is conducted. 
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3.0 DETAILED RESEARCH PLAN 


This chapter describes the major elements of the research plan. A careful examination of the 
details of this plan is needed to understand the costs involved in implementing the research plan. 

A brief rationale is provided for each element. 

3.1 Airport selection and evaluation 

The first three elements describe the procedure that is followed to select one or more airports for 
a noise change study. As was noted earlier, this is one of the three major problems that has 
weakened previous noise-change studies. Although the discussion focuses on the selection of an 
individual airport, it should be noted that a stronger study design would include several airports. 
Similarly, a road traffic study would be strengthened by the inclusion of a large number of 
road/change situations. 

Element HI : A comprehensive list of all changing airports in the United States is developed 
and then subjected to an initial, systematic screening process to develop a short 
list of candidate airports . 

Details: This element is designed to identify all possible candidate airports in the United States. 
Two of the essential steps for executing this element are: 

1) A data base is established that includes all U.S. airports that have specified types of 
planned changes within a stated period. This list comes primarily from data bases 
and planning documents. Airports are entered into this database if any large 
changes are planned. Whether or not the change will be associated with a change 
in noise exposure is only assessed in the next screening step. 

2) All airports in the data base are then screened using standardized screening criteria. 
The results of the screening are entered in the data base. Most of the information 
for this screening phase comes from personal contacts with FAA, military, and 
airport personnel. This initial, documented screening is based on criteria 
concerning: 

a Date of change (must be within the study period) 

b Size of the expected change in noise exposure (LAeq 24hr or DNL) 

c Length of transition period (an abrupt change is needed) 

d Numbers of dwellings exposed to changes in noise exposure 
These steps were conducted to attempt to identify candidate airports in 1998. That search 
procedure is documented in Appendix A. The exact criteria that were applied in that search and 
the sources of data explored are also described. Almost all of the initial screening at this stage can 
be conducted by telephone. Extensive sets of telephone calls are needed foi the most likely 
airports to confirm noise/change plans. Short visits of less than a day are conducted for airports 
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where the locations of dwellings are uncertain. 

Although only two screening steps are explicitly specified, it is likely that more complex, multi- 
phase checks will be needed on the accuracy of the information before a final decision is reached. 
Areas of special concern are the accuracy of the information about the pre-change noise exposure 
in the 14 months preceding the change, the extent to which published plans for the change are still 
likely to be implemented, and the distribution of dwellings within the study areas around the 
airport. 

Rationale: This procedure is designed to identify the maximum number of airports that reach 
certain eligibility criteria rather than to simply identify a fixed number of “acceptable” airports for 
the following reasons; 1) Multiple study airports are highly desirable for the purpose of reducing 
the correlated variables problem; 2) An airport that appears to be acceptable in this initial 
screening phase has a high probability of being rejected or found to be substantially inferior to 
other airports as a result of the detailed screening process applied at the next stage; 3) Airport 
operations and study plans are sufficiently volatile that a data base is needed to be able to rapidly 
assess alternative sites. 

Element M2: Selection of a study airport is based on the results from a simulation model that 
predicts whether the available noise environments and numbers of potential 
respondents are sufficient to provide an accurate estimate of the abrupt change 
effect. 


Details. This element has been executed for two airports. The evaluation is documented in 
Chapter 6. Analyses of previous social surveys were conducted to develop a computer program 
that predicts the accuracy of noise/change study results for alternative study designs (Chapter 6 
and Appendix G). Conducting the entire evaluation required in this element is a significant 
project. The detailed steps are the following: 

1) Predict noise levels to the nearest decibel before and after the change in exposure 
at all populated locations near the airport. 

2) Merge a data file of census blocks containing location and population information 
with the before/after noise change data. 

3) Create one or more sample designs that are consistent with the constraints 
imposed by the noise-level and population distributions in the file. 

4) Predict the accuracy of the sample designs by running the study evaluation 
computer program that reads the data file. (The complexity of this task depends 
upon the number of alternative designs and noise-response options that are 
evaluated.) 

5) Confirm the availability of the expected numbers of dwellings in the most critical 
noise situations through an on-site visit in which the dwellings are enumerated 
within each area. (The timing of this visit depends upon the relative costs of a site 
visit and the preceding analysis.) 

An “accurate estimate” is defined in Element #9 below and further discussed in Element #23. 
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Rationale: The alternative of choosing the apparently “best” airport using a simpler procedure 
was rejected because it is judged that a simpler procedure will not give sufficient information to 
determine whether a study can be expected to succeed. The simulation program is described m 
more detail in the appendices. The program predicts the sampling errors for estimates of the 
abrupt/change effect parameter in a noise/change model. These standard errors are predicted in a 
simulation program that generates several hundred alternative social survey sample outcomes for 
the levels of response variance that have been identified in previous surveys. As will be noted 
later, the same program also shows the extent to which specific types and sizes of errors m 
estimating the noise exposure will bias estimates of the abrupt/change effect parameter. A 
simulation program is needed because it can readily evaluate the effects of complex sample and 
statistical error structures that could not be easily modeled with existing statistical theory. Actua 
population and noise/exposure data are needed from the airports to represent the complexity of 

the sample design. 

Element #3 : The cooperation of local airport and FAA officials is obtained for the study. 

Details: Local airport and FAA officials will need to provide detailed data about aircraft 
operations, information on the timing and description of the abrupt change in exposure, and 
information about any changes in operation patterns during the study period. 

Rationale: Examinations of other aircraft operation-change episodes have shown that plans often 
change and may not be publicized. The information that is needed for estimating the noise ^ 
exposure during the study period is sufficiently detailed that it could not be economically obtaine 
from any other source than the airport authorities* 

3.2 Fundamental study-design elements for measuring the abrupt change effect 

The next six elements describe the variables and procedures that are contained in a social survey 
to give an operational definition of the noise change effect. Analysis methods are not specified 
here but are illustrated in a later chapter. 

Element # 4 : The definition of the abrupt change effect is the difference between the after- 

change annoyance at a specified noise level and the annoyance that would 
occur at the same noise level under steady state conditions. 

Details: This difference is expressed in units of annoyance scales as well as in terms of the 
number of decibels that would generate an equivalent difference in annoyance responses (Decibe 
Equivalent Annoyance Units (dBEAU)). At least two models are tested to evaluate difference in 
annoyance responses at two points of time: 

1) The novelty effect model assumes that the incremental increase in annoyance is the 
same for all changed environments 

2) The level-dependent model assumes that the incremental increase in annoyance is 
related to the size of the change in noise level. 
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The estimates of either of these abrupt change effects can be derived from regression equations of 
annoyance (before and after a change) on the measured noise levels and the change in noise level. 
Alternatives to linear regression will be explored. 

Rationale: The primary purpose for examining reactions under changing conditions is to 
determine whether the same dose/response relationship can be assumed to hold for steady-state 
and changing noise conditions. 

Element # 5. The measures of “steady-state” annoyance and “ after-change ” annoyance 

come from responses to the existing aircraft noise at an airport approximately 
one month before the change and approximately one year later at 11 months 
after the change. 

Details : Interviews in the before-change phase are spread over a four-week period (between six 
and two weeks before the change). Interviews after the change are spread over the next year’s 
same four weeks, 365 days later. 

Rationale: This element establishes before-change interviews at the same airport as the 

baseline against which the post-change reactions are measured. The overwhelming strength of 
this design is that it reduces the effects of a large number of variables that are correlated with the 
time and location of a social survey by controlling for many measured and unmeasured city, 
airport, neighborhood, and individual characteristics. The three following alternative baselines 
were considered as a basis for comparison but rejected. 

Design 1 : An “after-only” design that compared “changed-exposure” respondents with “no- 

change” respondents at the same airport was rejected on theoretical grounds 
because the substantial differences observed between responses in different areas at 
the same noise level in Appendix G and earlier analyses (Fields, 1983) would mean 
that the design could not determine whether the change and no-change areas had 
similar responses (after being adjusted for noise level) before the change. 

Design 2: An “after-only” design that compares new, post-change residents with residents 

who were present during the change was rejected because new in-migrants might 
differ in other ways and because of the practical difficulties in finding enough in- 
migrants. 

Design 3: An “after-only” design that would compare reactions at the change airport with 

reactions at other airports was rejected because substantial airport-specific 
differences in reactions would be confounded with any effects of changes in noise 
exposure. All major comparisons of reactions in different noise surveys have 
found very large differences between the dose/response relationships at different 
airports (Schultz, 1978: Fidell, Barber, and Schultz, 1991: Miedema and Vos, 

1998). Irrespective of how stable such previous combined estimates might be, the 
estimate from the single or small number of noise/change airports included in the 
present study can not be assumed to be close to the mean of the previous 
estimates. Of course some of the previous observed variation between studies is 
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probably due to differences in the study methods, years and languages of the 
previous studies. However, analyses of neighborhood differences (Fields, 1983) 
and of the differences between nine US airports within the same surveys show that 
there are substantial between-airport differences in reactions even after noise level 
and obvious differences in study methods are eliminated. 

The before-change baseline at the same airport eliminates the substantial problems introduced by 
each of the three alternative designs. The following apparent weaknesses of the before-change 
baseline were considered but rejected as not being of sufficient importance to overcome the more 
serious, previously-enumerated weaknesses of the three alternatives. A before-change design 
requires that the study be designed and interviews be conducted before the change takes place. 
However, it is argued later that this is not a substantial additional burden if, as is argued below, 
the noise environment must be monitored several months before the noise change. A before- 
change study requires that at least some residents be directly informed of the planned change. 
However, this would appear to pose little risk of changing attitudes because (1) many respondents 
will be aware of the nature, if not the timing, of the proposed change and (2) analyses of previous 
surveys have indicated that noise responses are not biased when interviews are separated by 
several months. The before-change design is subject to a confounding of abrupt change effects 
with other changes that occur between the two interview phases. Attempts are made to either 
measure or use controls in the analysis such changes. The possibility of any such confounding 
changes is judged to be less than the known between-area effects that are documented in 
Appendix G and previous studies (Fields, 1983). 

Primary reliance is placed on a 12-month spacing between waves because this spacing partially 
controls for seasonal differences in response and because this provides a sufficiently long period 
after the change to be of importance for planning purposes. The analysis in Appendix E shows 
that there can be substantial seasonal effects. In that appendix it is noted that the sources of 
seasonal effects have not been studied but could be a complex combination of factors that include 
weather on the day of the interview, weather during an unknown period preceding the interview 
over which the respondents integrate their responses, and cultural factors that determine the 
extent to which respondents are likely to open windows and have out-of-door activities at 
particular times of year. Given the unknown, but potential, complexity of the seasonal effect and 
the larger number of these factors that are controlled with interviews at the same time of year, it is 
recommended that the primary reliance be placed on interviews at 12 month intervals. 

Interviews are spread over a four-week period rather than being concentrated in a shorter period 
to minimize the impact of any day-to-day fluctuations in noise exposure or annoyance levels such 
as those that were found in one survey on reactions to helicopter noise (Field and Powell, 1985: 
32-33). The longer period also allows more time to increase the response rate and numbers of 
interviews through repeat call backs. Short interviewing periods have sometimes been 
recommended for noise surveys in the past due to fears about publicity attending the survey. 

Cases of such publicity have not been documented in the noise survey literature and are expected 
to pose less of a threat to the successful estimate of an abrupt change effect than would be 
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introduced by a short interview period. 

Element # 6: The primary interview measure of a before/after change is a measure of the 

difference between each respondent’s before-change response and his/her own 
after-change response. 

Details: Although some interviews are conducted with new respondents in the after-change study 
waves, the primary reliance is on a longitudinal study design. 

The following details are important: 

1) Careful records are kept to make it possible to link individual respondent’s 
responses across the different study waves in the analyses. 

2) All respondents in the rarest noise exposure categories are in the panel design. 

3) The number of new sample members for the one-year follow-up survey are 
restricted to the number needed to provide a satisfactory test as to the presence of 
a repeated-interview bias. 

4) The one-month, post-change survey, if any, is not conducted with respondents 
who are scheduled for the one-year follow-up survey. 

5) The one-month, post-change survey, if any, is approximately evenly split between 
previously interviewed and new sample selections. 

6) The one- mo nth, post -change survey, if any, is not conducted in critical, small 
population categories. 

Rationale: The analyses provided in Appendix D indicate that repeated interviews may 
substantially increase the precision of survey results but should not result in biased estimates for a 
one-year follow-up survey. The one-month followup wave uses more new respondents due to 
concerns about possible repeated interviewing effects. The secondary importance assigned to 
these interviews also results in their not being conducted in noise environments with small 
populations. 

Element U7: Estimating the form of a post-change, annoyance decay function is a low- 
priority task that would require additional interviewing phases in the weeks 
immediately following the change, at two years after the change, and, under 
favorable conditions, at some intermediate points of time. 

Details: It is expected that an abrupt change effect is largest at the time of the change and then 
gradually decays over time until reactions are the same as in the previous steady-state condition. 
Yearly follow-up interview waves beyond that scheduled for 12 months will only be conducted if 
a large abrupt change effect is found at the 12 month follow up. Interviews would only be 
conducted in the weeks after the change or in later months before the 12-month follow-up if the 
climatic and social conditions suggest there will be no seasonal effect and if documenting a 
possibly large abrupt change effect immediately after the change is important. 
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Rationale: Estimating the form of the relationship between the time elapsed since a change and 
the abrupt change effect is set as a relatively low priority task because it is likely to be expensive 
and the likelihood of success is uncertain. This judgment is a result of the following assumptions: 
1) a substantial seasonal effect could confound any attempt to measure a decay in reactions except 
at the same time of year (See Appendix E.); 2) the decay of an abrupt change effect is likely to be 
an exponential or similar function in which the decay is rapid in the first few weeks or months; 3) 
the amount of the abrupt change effect after one year will be small; 4) the difference between 
weather conditions in the several months surrounding the change will be small; 5) there will be too 
few households in the most important noise-exposure categories (large noise-change groups) to 
provide new respondents for an additional study wave at one month after the change in noise; 6) 
actually specifying the shape of a decay function would require a large number of interviews at 
many different times; and 7) the primary goal of the study is to determine whether an abrupt 
change effect persists at least a year after a change in noise exposure. The recommendation for 
interviews immediately after the change is based on the assumption that the abrupt change effect 
is likely to be greatest at this time and the judgment that the credibility of a finding that there is no 
abrupt change effect at one year would be enhanced if the same study showed that there had been 
an abrupt change effect at an earlier time. If the study were conducted in an area with relatively 
small seasonal climatic differences then additional interviews during the first year might be 
considered. 

Element # 8 : The social survey sample of residents is designed with the goal of maximizing 

the precision of the estimate of the abrupt change effect as predicted by the 
social survey simulation program. 

Details: The same simulation program that is used to select a study airport is used to predict the 
accuracy of different sizes of samples and distributions of samples between noise environments. 

Rationale: The impact of the allocation of the sample design is too difficult to judge without a 
simulation. 

Element U9: The statistical goal for the study design is to detect a statistically significant 

change in annoyance due to a change in noise exposure if the change in 
annoyance is the equivalent of a five-decibel difference in noise exposure under 
steady-state conditions . 

Details: This is the statistical goal that is used to determine whether an airport can yield 
sufficiently accurate estimates to be accepted as a study airport (Element #2). This minimum 
precision goal can be stated as follows: 

To detect a statistically significant (p<.05) change in reactions (beyond that 
predicted for steady-state conditions) due to an abrupt change in noise exposure if 
that change in reactions is equivalent to a five-decibel (DNL) difference in 
exposure to an unchanged noise environment. 

The goal is stated in terms of the difference in annoyance that is predicted from data that have 
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been collected at two times. The difference in annoyance is the difference between the annoyance 
score that is predicted under steady state conditions and the annoyance that is observed after the 
change in noise exposure. The size of the difference in annoyance that is to be detected is the 
difference that would be expected between two locations that differed by five decibels in their 
noise exposure under normal, unchanging airport noise conditions. The definition of statistical 
significance is set at p<0.05. 

Rationale: A study must be able to detect a change in annoyance that is the equivalent of a five- 
decibel difference in steady-state reactions because many noise-regulation adjustments are made in 
five-decibel steps. Five decibels are taken as the minimum size on the assumption that a study 
that could not detect the effect of a five-decibel change in noise level would not be useful for 
practical applications. The goal is stated in terms of a simple linear model rather than more 
complex logistic or exponential models that more closely describe the relation between noise and 
such measures as “high” annoyance over a very broad range in noise levels. This simplification is 
accepted because: 1) the actual range of noise levels included in the study plans is likely to be 
restricted to a range over which linear models are approximately correct, especially for multi- 
point annoyance scales (not binary “high” annoyance scales); 2) the differences between linear and 
more complex models are likely to be small relative to the other inaccuracies that are present in 
the variance estimation process; and 3) it was felt that it was better to devote the limited model- 
development resources to assessing such issues as the effects of errors in noise measurements and 
the impact of a clustering of responses within geographical areas. 

This method of explicitly stating the goal of the study is important because it provides a basis for 
evaluating the study designs. Depending upon the purposes of a study different, more rigorous, 
goals might be set. 

3.3 Social survey administration procedures 

The next five elements describe selected decisions about the administration of the social survey. 
Justifications are provided for difficult decisions about the types of data collection methods that 
are to be used. 

Element #10: Face-to-face interviews are conducted for the primary social surveys (before 
and 12 month interviews) but short telephone interviews are used for any 
interim follow up interviews. 

Details: The face-to-face interviews are conducted with a long survey form. The telephone 
interviews are conducted with a shorter form with questions drawn from the long form. 

Rationale: The longer, face-to-face questionnaire is needed for the primary surveys because it is 
expected to give the highest possible response rates in areas with small numbers of dwellings, 
permit greater flexibility in the types of questions and visual materials that can be used, and 
maintain greater comparability with previous surveys. Comparability with previous surveys can 
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be maintained through the use of show cards and sequences of questions that conceal the primary 
interest in changes in aircraft noise. Difficult magnitude estimation questions can be administered 
with visual aids. This questionnaire collects information about both long-term and short-term 
reactions. Face-to-face data collection methods are expected to be only slightly more expensive 
than other methods since all homes must be visited and all interviews will be conducted near one 
airport or, at most, a very small number of airports. 

The shorter telephone questionnaire is needed to obtain immediate information about reactions 
on specific days when respondents are telephoned in the evening. A short telephone survey 
allows a greater number of short interviews to be collected in short period of time than would an 
interviewer-administered survey. 

Element #11: Interviewers are managed with procedures that enhance the quality of 

interviewing. 


Details: The following are among the standard interviewer management procedures that are 

followed: . , . 

Interviews are conducted by professional interviewers or interviewers who have 

completed a multi-day course in interviewing methods. 

A handbook that describes the questionnaire administration procedures is 
prepared. (Some of the contents of this handbook are given in Appendix K.) 

A one or two-day orientation session is conducted for the survey. 

Interviewers are not informed about the expected noise levels or measured changes 
in noise levels in their study areas. 

5) Supervisors accompany interviews on early interviews and on occasional later 
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3) 
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interviews. 

6) Telephone interviews are conducted from a central location where they can be 
supervised. 


Rationale: Even random measurement errors can not be compensated for through increased 
sample sizes for the survey due to the restricted population sizes expected in the rarest noise 
environments. As a result care needs to be taken to control other sources of error. 


Element #12: Interviewer assignments are not clustered by location. 

Rationale: Interviews in each area are conducted by as many interviewers as possible to reduce 
the correlation between any interviewer effects and other area effects. The possibility of 
interviewer effects have not been explored in other surveys but are a possible explanation of the 
large geographical effects in noise surveys (Appendix G). 

Element #13: Letters of introduction are mailed to sampled dwellings before the interviewer 
attempts to conduct an interview. 
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Details: The letter describes the survey as an environmental survey but does not refer to noise. 

A letter is mailed for both face-to-face and telephone interviews. 

Rationale: Letters of introduction can be expected to increase response rates. Such letters also 
increase the perceived legitimacy of the survey. This is especially important for this survey 
because it should reduce respondents’ security concerns about giving information about their 
times at home on the one-day response portion of the questionnaire that is included in both the 
face-to-face and telephone interviews. 

Element #14: Respondents are randomly selected within households using a Kish selection- 

grid 

Rationale: Control is needed over the selection of respondents within households to avoid biases 
in the estimates of abrupt change effects. This is especially important because people who are 
often at home and people who are not often at home may differ in their awareness of changes in 
exposure. The Kish selection grid uses a probability selection method for selecting respondents 
(Kish, 1965). 

3.4 Questionnaire wording and design 

The next four elements describe and justify major decisions about the construction of the 
questionnaire. The questionnaire is reproduced in Appendix H. The wording of each question 
was carefully considered by a team of researchers during the course of a series of small pretests at 
two noise change airports. The justifications for some of the questions are given in Appendix J. 

Element #15: The primary noise/annoyance response question measures the respondent’s 
annoyance with the aircraft noise environment that exists at the time of the 

interview. 

Details: This question is used before respondents are aware that the survey is about changes in 
aircraft or about changes in noise exposure. The question is preceded by the introductory 
instruction “If there have been any recent changes in the noise around here, please tell me about 
the way it is nowadays.” 

Rationale: Retrospective reports about previous annoyance levels are not to be used to estimate 
the abrupt change effect. Several questions about reactions to the pre-change environment are 
included in the questionnaire but only to determine if respondents believe there has been a change 
in their reactions. The decisions about the wording of the questionnaire were made after carefully 
weighting the risks associated with the following possibilities: 

1) Some respondents will not be aware of any changes in the noise environment. 

2) Respondents will probably not be able to recall the noise and accompanying 
reactions for periods that are artificially defined in an interview. 
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3) Respondents may only be able to reconstruct the noise environment and their 
reactions on an episodic basis for the last few hours or for the day in which the 
interview occurs. 

4) Some respondents may bias their responses if the issue of the changed noise 
environment is raised. 

5) Other respondents may only be able to report their reactions for a period, if the 
period is delimited by the change in noise environment event. Their knowledge of 
the timing of the event may be too weak to usefully refer to a post-change period 
in any other way. 

6) Respondents can only be expected to give their current feelings, not to accurately 
report previous feelings. 

7) Respondents will want to report the responses that are most important for them. 

8) There may be a tendency to telescope previous events into the reference period 

9) Respondents can not predict their reactions in the future. 

Element if 16: After the initial primary annoyance questions, all respondents are informed 

about one aircraft noise change that has occurred in their area in the past and 
about one that is planned for the future. 

Rationale • After a few initial questions in which the specific change in aircraft operations is not 
mentioned, the recent change in aircraft operations is directly described and most of the remaining 
questions directly ask for reactions in the period after that change. Many questions ask for 
reactions "after the ..(specified)., change in the last ... months.” This approach was taken because 
it ensures that the respondent can clearly identify the period being asked about. An alternative 
that was rejected was to only mention a time period, for example the “last 12 months” without a 
mention of the noise change event. It is judged that this approach would have increased reporting 
errors because respondents would not be sure about the time of the change in operations an 
would not be certain as to whether these "unusual" changes should be considered in giving 
information about their noise environment. 

Element it 17 : The same questionnaire is used for the before-change survey and the 12-month 
follow-up survey. 

Rationale: This simplifies survey administration and ensures that responses will not be biased by 
the mere discussion of changes in noise environments. This also provides a baseline to measure 
the extent to which residents perceive change in an environment that the investigators presume 
has not changed. The interviews both before and after the change therefore refer both to a 
previous change in the past as well as a planned change in the future. Because aircraft operations 
are constantly changing it should be possible to identify an additional past change for the before- 
change interviews and an additional planned change for the after-change interviews. No problems 
were found during the pretests with such questions about obscure, unpublicized changes in airport 

operations. 
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Element #18: The face-to-face questionnaire contains two variations that require two slightly 
different forms of the questionnaire. 

Details: The two different forms of the questionnaire are given to alternate households in each 
study location. Forms are color-coded to help ensure that the forms are correctly assigned. The 
few pages that differ between the two forms are provided in Appendix H. 

Rationale: The questionnaire form is altered in two locations. One location, near the end of the 
questionnaire, alternates between two different annoyance questions. The alternative reaction 
questions (Q39A or Q39B) come from two of the largest scale previous studies of reactions to 
changes in noise environments for which the data are still available. They are included for 
comparisons to those previous surveys. It was felt that both could not be included in the same 
questionnaire without being overly repetitious or creating confusion because of the slight 
differences between questions. The numeric seven-point scale (Q39A) was used in the Southern 
England Road Opening Survey (UKD-237, UKD-297). The five-point verbal scale was used in 
the Burbank Aircraft Noise Change Survey (USA-203). 

In the second location, a question order experiment tests for any differences between two orders 
for asking about pairs of noise reaction questions (Q. 16 and Q.17) the have been used in previous 
studies. The test is conducted because of concern that the two forms could generate different 
estimates of the amount of activity interference. In one form the respondent is first asked about 
whether each of six activity interferences occurs before being asked about annoyance reactions 
(Q16A). In the other form the question about annoyance immediately follows each screening 
question about experiencing interference before the next screening question is asked (Q16B). 

3.5 Monitoring of publicity and the community context for aircraft noise controversy 

The next two elements require data that are gathered outside of the questionnaire survey. These 
data concern local publicity and past or present events that could affect the evaluation of aircraft 
noise in a community. A more thorough discussion of these issues is contained in Chapter 4. 

Element #19: A historical time line of official airport planning bench marks and major 
public events is generated that extends from the earliest discussions to the 

present. 

Details: A record is prepared of major events from the time when the possibility of the change in 
the airport was first discussed. For many changes that have a long-term history of related 
planning exercises the time line may stretch for ten years or more. The information for the early 
years is only needed if it can be relatively easily obtained from official files or easily-accessible 
electronic data bases. The time line is much more detailed for the two or three years proceeding 
the planned change. The work on this time line is begun before the final airport selection decision 
is finalized and is brought up to the current date by the time that modifications for the before- 
survey are considered. The time line should include at least the following information: 
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Major airport improvement milestones such as master plan preparation, appearance 
in National Plan of Integrated Airport Systems (NPiAS), Airport Capital 
Improvement Plan, initial design plans, environmental assessment (EA), grant pre- 
application, environmental impact assessment. Part 150 study, final design, land 
acquisition, implementation of mitigation measures and construction. 

Newspaper articles that are archived in an electronic data base. 

Public hearings or other public events held in connection with the airport 
The meetings and other events that airport officials can identify in which the 
community learned about the planned change or formed opinions about 
airport/community relations. 

Rationale: This gives the basic, historical framework for searching for additional information 
about community/airport interactions. It is assumed that obtaining this information is not a major 

task. 

Element #20: A detailed time line of public events and publicity about the change during and 
immediately before the study period is maintained during the entire study 

period. 

Details: The study period is considered to start from approximately one year before the first 
interviews because respondents are asked for reactions during that period. The information that is 
available to community members during the study and the period preceding the study is gathered 
in the form of copies of all relevant documents and assembled in a data base with a time line on 

the basis of at least the following data gathering efforts: . 

1) Searches of electronic files, clipping files, back issues, and current issues of all city 
and local newspapers, 

2) Reading of neighborhood association newsletters in the affected neighborhoods, 

3) Monitoring of local television news programs 

4) Any other sources of information that residents may have about the airport. 

To gather current information for each source, the project subscribes to the publications and 
monitors local television news programs. Locating neighborhood newsletters and other local 
sources of information will probably require a rather intensive research effort. More information 
about the assembly of these data is available in Chapter 4 on monitoring local publicity. It is 
important that these data remain current during the study period as they could affect study plans. 

Rationale: This information is needed to provide a basis for understanding the role that publicity 
may play in the community’s reactions to the change in aircraft noise exposure. The information 
can be directly used to modify the study design. The timing of local events might need to be 
considered in scheduling interviews. Some questions in the questionnaire about local sources of 
information and local aircraft events are based on this information. The after-change 
questionnaires may also be modified, if necessary, to measure respondents’ exposure to local 
publicity and perception of local events that might modify attitudes toward the changed aircra 
noise environment. All of this information will help in gauging the place that local publicity plays 
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in affecting attitudes towards the changed aircraft noise environment. The material that is 
gathered in this program would also provide the basic data for a final assessment and description 
of the place of publicity and community events in the study community. 

Experiences with electronic data bases and national news data base services at pretest airports 
showed that these sources did not contain sufficient local information. The relatively labor- 
intensive monitoring of local news events was found to be essential. 

3.6 Noise exposure measurement and documentation 

Element #21 : DNL is calculated for each respondent for the periods for which long-term 
reactions are measured in the questionnaire. 

Details: DNL, Daytime LAeq and Nighttime LAeq are measured or estimated for each 
respondent’s residence. The method for developing these methods can not be specified in general 
since it will depend upon the types of data that are available and can be gathered at any particular 
study airport. Noise exposure is described as being “estimated” for a particular dwelling for a 
particular period in this section because the exposure at every dwelling for the entire period 
referred to in the questionnaire (for example the previous year) can not be measured. The 
following principles are followed in developing these estimates. 

1) The noise estimates for long term reactions (Q8, Q14, Q16a, Q17a, Q18-19, Q38- 
39) will be for the previous 12 months for the before questionnaire and for the time 
from the date at which the noise environment stabilized after the change until the 
beginning of the interview period for the 12-month follow up questionnaire. 

2) If the short telephone survey is conducted in the month or two following the 
change in exposure, the stability of the noise environment since the change is 
assessed to determine when the noise estimation period should begin and whether 
the noise exposure needs to be adjusted for the date-of-interview. If the day-to- 
day noise exposure has been highly variable after the change, then it may be 
necessary to have estimates that are adjusted up to the day of the interview. 

3) Estimates are made of the exposure that would occur at the most exposed facade 
of each respondent’s dwelling in the absence of that facade. 

4) Separate estimates are prepared for day-time and night-time LAeq as well as for 
DNL 

Rationale: The noise measurements should match the noise environment about which 
respondents are asked. No adjustments are made for outdoor/indoor attenuation because outdoor 
exposures are used in most noise regulations and introducing outdoor/indoor transfer functions 
would increase the error in estimates. No adjustment is made for times when respondents are 
home because previous surveys have indicated that time-at-home is not related to long-term 
reactions (Fields, 1993). 

Element #22: The noise measurement program is designed to achieve a level of accuracy that 
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will not substantially bias estimates of the abrupt change effect. 

Details: The survey design evaluation tool described in Chapter 6 is used to set noise 
measurement accuracy goals. This process involves the following: 

1) The social survey simulation program is executed with different assumed levels of 
precision and patterns of biases in the noise measurement program. 

2) The extent of error that can be present without unacceptably biasing estimates of 

^ the abrupt change effect is determined from the simulations. The definition of 

“unacceptable” biases will need to be assessed for any particular survey. 

3) A noise measurement program is designed so that it is expected to generate no 
biases or only small biases that are deemed to be “acceptable.” A provisional 
goal would be to have biases of less than the equivalent of two decibels in the 
estimate of the abrupt change effect. 

Rationale: The degree of precision that is required from the noise measurement program can not 
be known without examining the probable effects of these errors on survey estimates. This 
information may even be important in deciding whether or not to perform the study. 

Element #23: The accuracy of the estimates of DNL is quantified and used to adjust estimates 
of the abrupt change effect. 

Details: Both the bias and the sampling errors associated with the survey’s estimates of DNL are 
estimated. In planning such a program the following factors are considered: 

1) A survey statistician is likely to be needed to design an effective program for 
estimating the standard errors of the long-term estimates of DNL. 

2) The possibility that sampling errors are substantially different at different noise 
levels or locations is evaluated. 

3) Sources of possible bias in the estimates for different types of locations are 
evaluated. 

4) It is expected that a significant portion of the noise estimation resources, perhaps 
10 percent, is devoted to this effort. 

5) Final estimates of the abrupt change effect are adjusted for estimated errors in 
estimating noise levels. 

Rationale: Estimates of dose/response relationships can be biased by random errors in noise 
measurements. Systematic errors in estimating noise exposure for rare, important areas (for 
example areas with large changes in exposure) could distort the study estimates. 

Element #24: An estimate of aircraft noise exposure is calculated for each respondent for 
each day during the study period. 

Details' An estimate of DNL and daytime and nighttime LAeq is calculated for each respondent 
for each day during the study period. These estimates start from as early as 12 months before the 
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first interview and continue until the last interview for the last study wave. Special attention is 
devoted to estimating the exposures during the few highest exposure periods in the evaluation 
period before each interview (previous 12 months for before-change, and time since change began 
for after-change interviews). Although information about the accuracy of these daily estimates 
would be useful, the daily estimates do not require the same degree of scrutiny as the long-term 
DNL estimates mentioned previously. It is expected that these estimates could not be formed 
from direct measurements but would, instead, be estimated from information about the airport 
operations on each day. Strategies need to be developed for estimating exposures on days when 
there is missing data. Estimates of the daily levels during the twelve months between the before- 
change interview and the last interview wave are monitored on approximately a weekly basis to 
determine whether the change in airport operations and noise exposure is as expected. 

Rationale: The daily exposure information is needed for the following purposes: 

1) A comparison of the distribution of high exposure days before and after the change 
will help to determine the extent to which particular respondents are exposed to 
clearly different types of exposure days. An absence of reactions to change may be 
traced to the fact that the change in exposure reflects only a change in the 
distribution of exposure days but no change in the highest noise exposure days. 
Alternatively, it might be found that the change in exposure only affected 
weekdays during times when most residents are absent from their homes. 

2) The noise exposure on the highest noise exposure days will be used to estimate the 
noise exposure to match the periods referred to in Q32b and Q32d in the face-to- 
face, long form questionnaire and in Q5b and Q15d in the short form. 

3) The information about the daily exposure patterns during the time of the change in 
operations will make it possible to determine when the new operation and noise- 
exposure pattern stabilized and thus to measure the length of exposure to new 
“steady-state” conditions for the after-change interviews. 

4) When the information about the new exposure patterns is examined in the weeks 
and months after the change, decisions about the final social survey study waves 
can be confirmed or changed. Much smaller than expected changes might, for 
example, led to a significant reduction in the effort devoted to the ongoing 
monitoring and the final wave of interviews. Other unexpected changes in 
exposure might require additional study waves. 

Element #25: Limited information about general changes in the within-day patterns of 
aircraft noise exposure is gathered. 

Details: Information about changes in the patterns of daily noise exposure is gathered to the 
extent possible. Aspects of the daily exposure patterns to be examined include the highest peak 
noise levels, the hours of day when exposure is greatest, gaps between aircraft noise events, 
extent to which flights are directly over homes, duration of overflight noise events, and the extent 
to which such changes are perceptible outside of normal weekday working hours. Although it is 
not expected that information is available on a daily basis or for individual respondents, it is 
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expected that it would be possible to determine whether such general patterns of changes were 
likely to be experienced in all areas or only a small number of areas. 

Rationale: This information may help explain the extent to which people are aware ofch ^g^m 
noise exposure. For example, such information should help to determine whether any of the days 
afer the change were distinctively different from the days before the change. 

Element #26: The accuracy of the estimates of the DNL for the first few after-change weeks is 
determined. [This is only needed if interviews are conducted in the month after 

the noise change.] 

Details: If the short telephone survey is conducted in the few days or weeks following the change 
then estimates of the noise exposure are needed for these short time periods for all telephone 
respondents. The accuracy of these estimates is also needed. This is likely to involve a maj 
increase in the noise exposure estimation effort because the unusual exposures on a small number 
of days at some sites could affect estimates. Information is needed on the accuracy of these 

estimates. 

Rationale: The primary measure for all post-change interviews is the noise exposure during the 
period after the change. This period is very short for the interviews conducted in the few week, 
after the change. Estimates of noise exposure for short time periods are likely be considerably 
less accurate than those for the longer time periods that are required for the ^fore-change " y 
and the 12-month follow-up wave. Comparisons between the suivey results from the diSerent 
waves will require that the accuracy of the noise data be assessed separately for the short periods 
and the long periods. If the additional step were taken of predicting the accuracy of the short- 
term estimates then these predictions might enter into the decision aboul whether or not to 
conduct the short-term interviews. 

Element #27: An estimate of the noise exposure from 6 A.M. up to the minute of the interview 
is calculated for each respondent’s interview date. [Low priority goal / 

Details' If the reactions to daily variations in noise exposure (Q25, Q30, Q31 in the long 
questionnaire form and Q8, Q13 and Q14 in the short form) are to be evaluated then the no.se 
exposure program estimates the exposure from 6:00 A.M. until the minute the mterview begins 
for each respondent on the day of each respondent’s interview at that respondent s dwe ing. 

Data about the timing of flights at each location can also be matched with information abou 
times when respondents were at home during the interview day. Some information needs to be 
obtained about the accuracy of such estimates. 

Rationale: If respondents do not overreact to changes in noise exposure or if the overall, long- 
term changes in exposure are small, then the ability of respondents to perceive any changes m 
noise exposure could become an important question. Collecting information about the exac 
times and approximate noise levels of flights is important because the flights that are close to th 
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time of the interview may have a strong effect on reactions and because analyses in a previous 
study found that this individualization of exposure measures to account for times when 
respondents were not at home did increase the correlation between noise and responses to date- 
of-interview noise annoyance (Fields and Powell, 1985). Data are needed for all phases, not only 
the short-interview phase, because the objective of the analysis is to compare reactions in the 
different study phases. 

3.7 Modifications to the questionnaire 

Element #28: Specific , selected elements of the questionnaire are finalized during the course 
of the study. 

Details: The following elements in the questionnaire are finalized and pretested at the selected 
study airport: 

1) A prior noise-change event must be inserted in the before-change questionnaire. 
This noise change event must have occurred at least 12 months before the time of 
the interview so that the previous 12 month’s noise measurements can be used. 

2) An anticipated future noise-change event is needed for all after-change 
questionnaires. This is an event that will be expected to occur several months or 
years after the 12-month follow-up study. 

3) The introduction in the post-change questionnaires is slightly modified for people 
who are being re-interviewed. 

4) The names of the local sources of media information need to be added to Q41, 

Q42 and, possibly Q13 and Q43. 

5) The question about military service (Q46) can be dropped if there are no military 
operations at the airport. 

6) If there are other major controversies about the airport or about local 
environmental issues, these are assessed in the questionnaire. 

7) If major events occur after the noise change that could affect reactions to aircraft 
noise, then consideration is given to adding any questions that might help to 
determine whether respondents are aware of the events and whether the events 
may have affected the respondents’ attitudes toward aircraft noise. 
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4.0 MONITORING AND EVALUATING PUBLICITY 


Methods for gathering information about residents’ reactions and measuring their noise exposure 
have been the subject of considerable study. Methods for gathering information about community 
publicity about noise problems have not been developed. This section discusses such methods. 
The section considers the evidence that could be evaluated to assess the relationship between 
publicity about aircraft noise issues and residents' reactions to that aircraft noise. The goals and 
strategy for a program to measure the effects of publicity are discussed. Most of the information 
presented in this section is based on limited attempts to obtain information about airport noise 
issues in three cities where changes in aircraft noise were expected or had recently occurred: the 
two pretest cities of Dallas and Memphis and one other city where a change is being planned, 
Madison, Wisconsin. A total of five newspapers and four television stations were contacted in 
these cities. Some information was also obtained as a result of examining the planning and 
approval process for airport improvements. 

4.1 Introduction 

Changes in aircraft noise are frequently surrounded by public controversy. The controversy is 
likely to involve both noise and non-noise issues. Residents' reactions to changes in aircraft noise 
exposure may be affected by both their personal experiences with aircraft noise exposure as well 
as by public controversy about the effects of that personal exposure and the predicted impact of 
new noise enviro nm ents. To fully understand the residents' reactions, information about the 
impact of public events is needed. 

Adequate estimates of the relative impact of public events and personal experiences require that 
studies be performed under different public event conditions. Any single airport, however, 
provides only a single history of public events. As a result studies at a small number of airports 
can not be expected to provide definitive information about the relationship between public events 
and residents' reactions. A study at a single airport or at a small number of airports could, 
however, be strengthened by a limited, well-documented study of local publicity that has clear 
goals. 

4.2 Publicity goals for a limited study 

Without systematic information about public events the results from any noise change study are 
difficult to interpret or evaluate for future use. The following goals are recommended for 
evaluating publicity for a standard abrupt change study: 

1. To quantify the extent of the public events and publicity about airport environmental 
impact issues that precede and follow a change in aircraft noise. 
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This information would enable future users of the dose/response survey results to 
determine whether the publicity conditions under which the dose/response study was 
conducted are similar or different from those in other studies or those in communities to 
which the study results might be applied. 

2. To determine the extent to which residents are exposed to such events and publicity. 

This information makes it possible to identify communities and residents who have such 
low exposure to public events that a publicity effect would not be expected. 

3. To determine whether there is a relationship between noise reactions, exposure to public 
information and attitudes toward airport-related authorities. 

Although the presence of a relationship between reactions and publicity in questionnaire 
data will not prove that there is a causal connection, the strength of the relationship will 
give some indication of the maximum effects that could be hypothesized. The absence of 
any relationship would provide useful evidence that publicity effects were small. 

4.3 Products from a limited publicity study 

The publicity study needs to be begun before the first round of interviews so that the 
questionnaire can be modified. The study needs to be continued during the times between 
interviews so that additional modifications can be introduced to the questionnaire and so that 
more detailed, immediate information can be easily collected about on-going events. Finally the 
study needs to analyze the results. The products that could be expected from such a study are 
grouped under three headings. 

Products at the pre-interview stage are the following: 

1. A time line of all events and publicity that occurred in newspapers, neighborhood 
newsletters, or television broadcasts before the first round of interviews; 

2. A listing of the major noise and non-noise environmental issues at the airport that have 
received any publicity; 

3. Modifications for the before-change questionnaire 

(This would include at least an updating of the list of local media sources in Questions 41 
and 42 and the identification of the pre-change issue that are the subject of questions for 
the before-change questionnaire. If there are additional major issues, then questions could 
be constructed and pretested to measure respondents' awareness and views of those 
issues.). 

Products at the between-phase stage are the following: 

4. A detailed listing of all events and publicity during and between interviewing periods. 
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5. An evaluation of possible modifications to after-change questionnaires, 

[The after-change questionnaire would not be expected to be modified from the before- 
change form (except, of course, for the references to the change event) unless there had 
been major public events during the period since the before-change questionnaire was 
administered.] 

Products for a final report are the following: 

6. A complete time line of the events and publications before, during and after the change 
together with references to the complete source for each published event and a measure of 
the prominence of the publication.; 

7. A paper or electronic copy of every printed article that appears in the above time line as 
well as transcripts of television segments, if available; 

Video tapes, or references to the source of a video tape, for each televised event, 

A discussion of the prominence of aircraft noise and other aircraft environment issues 
within the study area; 

10. A summary of the analysis of the questionnaire items concerning the public events and the 
relationship between noise reactions, exposure to public information and attitudes toward 
airport-related authorities. 

4.4 Methods for obtaining information 

The process of obtaining information about publicity in Memphis, Dallas and Madison has 
provided the basis for the methods suggested in this section. Although useful information was 
gained from the experiences in these three cities, it has also been concluded that the differences 
between information sources of different cities and neighborhoods are so great that a publicity 
study will need to be individualized for each airport community. 

The recommendations in the remainder of this section have been shaped by several observations 
during the tests in the three cities. The national electronic newspaper services do not include all 
local and suburban news sections. Requests for information about the contents of local media for 
research purposes are a routine event. Both print media and television stations have individuals 
who will readily provide information about their research sources and limitations. There have 
been major changes toward automated, electronic storage and retrieval systems for printed media 
sources from the late 1980's onwards. For example, newspapers originally had only "clip files" in 
which the actual newspaper story was cut out of the paper and filed (usually by date) in an 
envelope. Now newspapers have electronic files that cover some of the periods of publication. 
The most reliable method for obtaining stories from either newspapers or television is by knowing 
the date of a story. The television stations that were contacted were all uncertain about the 
success that could be expected from searches for key words. 

Information can usually be more easily obtained from newspapers than from television stations. 
Newspapers are likely to have particular reporters assigned to the city desk who produce most 
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stories on the airport. Television stations are not likely to assign a single reporter to the airport 
but are more likely to make their assignments for any particular story on the basis of who is 
available on a particular day. Newspapers may have a newspaper librarian. For television stations, 
however, the news director is only a starting point for obtaining information. Newspapers have 
routine archiving systems that are more or less well designed for, at least, their internal research 
needs. Television stations have less complete archives. In addition some stations encourage 
reporters to destroy notes to eliminate the possibility of their being subpoenaed for legal cases. 
Television stations may not retain even their video tapes for long periods. Newspapers are likely 
to be at least partially archived on national archiving systems such as Lexis/Nevis or Dialog. 

There is no similar national system for television news. 

The best sources of information differed for the three cities examined in the preliminary study. 
Sources that were found to be useful in at least one city are listed in the remainder of this 
paragraph. Newspaper clip files have complete stories up to the time when many newspapers 
started to store papers electronically. Newspapers have different policies about assessing this 
information. In addition to the electronic information in Lexis/Nevis or Dialog, some newspapers 
provide electronic access to their own files either through a web page or some other local access 
point such as a public library. There may be a newspaper librarian that will be of assistance. Some 
public libraries and state historical societies have good sources of information on local and 
regional issues either in hard copy, microfilm, or electronic media. At least one television station 
did not provide any information through its own offices. Instead, information could be obtained 
through a local information service. 

In addition to the information that is available locally, information may also be obtained from local 
airports and the FAA. Airport sources were not examined as part of this project. 

Devising an economical strategy for collecting data for an airport community depends upon local 
conditions. In addition, it is important to keep the limited objectives of this project in mind and to 
limit the resources that are devoted to the study accordingly. 

In general the greatest resources may be needed for locating the local sources of information that 
are most likely to have been read or noticed by the residents in the neighborhoods immediately 
surrounding the airport and for closely monitoring media during interview periods and between 
study phases. Local newspapers, neighborhood newsletters, airport mailings to local residents, 
and activities of local community organizations are all likely to be important, but potentially 
difficult to locate. In the early stages of the project it is expected that only minimal information 
could be obtained from the national, automated databases. Only a small amount of effort is 
devoted to searches of media long before the change. The primary focus is on more proximate 
events, especially any events during the course of the interviews. 

Emphasis needs to be placed on developing time lines of events because this is the only reliable 
way of identifying newspaper, television and other publicity. Emphasis should also be placed on 
obtaining a copy of every printed item. Participants' memories of the contents of printed items 
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may not be reliable. With a complete file of printed items the basic data will be readily available if 
a more complex problem is encountered. In addition, the printed items are needed to provide a 
basis for accurately worded social survey questions. 

The actual assessment of each printed item can probably be quite limited for the objectives of this 
project. Large-scale, complex content analyses are often conducted of media. Given the 
availability of a single airport and the limited objectives of the project, such a content analysis wi 
probably not be appropriate. Each printed item might be coded with information about only 
whether there was a mention of noise-issues or other airport environmental issues and about the 
amount of space devoted to noise issues. Unless publicity becomes a very major issue it should 
not be necessary to view television videos. 

4.5 Milestones for a major airport improvement project 

Airports share many common milestones that mark important stages in planning for major airport 
operation changes. Some of the major events are listed in the remainder of this section. The 
specifics could vary from airport to airport. This list is only for a major capital improvement such 
as the construction of a new runway. This list should however provide a general beginning point 
for developing the list of milestones for a specific airport. Some attempt should be made to 
determine whether each of the following milestones occurred and generated publicity: 


l Master Plan (up to 20 years before construction begins). 

The master plan, prepared by the airport, identifies needs in the next 20 years and outlines 
possible solutions (projects). The plan can be updated as new needs are identified Public 
meetings are often held in conjunction with master planning. The FAA finances the preparation o 
the plan. The final plan is a public document. 

2. National Plan of Integrated Airport Systems (NP1AS) (6 to 10 years before construction 

begins). t 

The FAA Airport District Office (ADO) manager and the airport representatives meet to discuss 

projects the airport proposes. The FAA decides which projects would improve capacity, safety, 
and security of the airport system as a whole. These projects become part of the National Plan of 
Integrated Airport Systems (NPIAS). The NPIAS list is a public document. However, not all 
projects on this list are implemented. 


3. Airport Capital Improvement Plan (ACIP) (5 years before construction begins). 

The airport submits an Airport Capital Improvement Plan (ACIP) to the FAA. This m ^ de * 
items from the NPIAS list, based on the required sequence of projects at that airport. 1 he ADU 
manager and the airport reach a consensus on the ACIP. This is not a public document. 


3. Layout Plan (5 years before construction begins). 

The airport prepares a layout plan that more precisely shows the affected airport areas. This 
document must be approved by the FAA. 
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4. Initial Design (4 to 5 years before construction begins). 

The funds for design usually come from the Airport Improvement Program (AIP). 

5. Environmental Assessment (EA) (3-1/2 to 4-1/2 years before construction begins). 

After the initial design is completed, an Environmental Assessment (EA) must be prepared. This 
is the first step in the environmental assessment process. The FAA must approve the Draft EA. 
Public hearings and solicitations for public comments follow that approval. Advertisements must 
appear in a local or area-wide newspaper 30 days before a hearing. Known interested groups will 
be contacted directly. Certain Federal, state, and local agencies (e.g. historic preservation and 
endangered species groups) are consulted during the preparation of this document. The FAA 
reviews the Final EA, including the public comments, and either issues a Finding of No Significant 
Impact (FONSI) or requires that an Environmental Impact Statement (EIS) be prepared. No 
public notice is required about the availability of the Final EA if it is to become part of the FONSI 
or Draft EIS within 60 days. These documents are then announced and made available. 

6. Grant Pre-application (3-1/2 years before construction begins). 

After the EA is submitted the airport can submit a pre-application for Federal aid. 

7. Environmental Impact Statement (EIS) (2-1/2 to 3-1/2 years before construction begins). 
If there was a finding of significant impact from the EA an EIS must be prepared. The FAA 
publishes a notice of intent to prepare an EIS in the Federal Register. The FAA recommends that 
a similar notice be included in the local media. After some initial planning a Draft EIS is prepared. 
The public is notified about the availability of the Draft EIS. The FAA prepares the documents, 
typically with a contractor. Public comments are included in the Final EIS. The FAA announces 
the availability of the Final EIS in the local media. After a 30-day comment period a Record of 
Decision on the proposed action is published in the Federal Register. 

8. Part 150 Study (2 to 3 years before construction begins). 

An airport will usually attempt to mitigate the effects of any proposed change. AIP funds may be 
used to mitigate significant environmental impacts. In order to qualify for AIP noise set-aside 
funds for the mitigation measures a Part 150 Study must be prepared. The study can also be 
performed independently of a major construction project. The Part 150 study outlines the 
proposed upcoming projects and a Noise Compatibility Program (NCP) that will be implemented 
to mitigate the effects of the proposed projects. It is usually prepared either concurrently or 
immediately after the EIS. The Draft study is reviewed by the FAA and in a public review 
process a year before the Final Study is published. 

9. Final Design (1-1/2 to 2 years before construction begins). 

The design for the project is finalized. 

10. Land Acquisition (several years before construction begins). 

11. Implement Mitigating Measures (start 1 year before construction begins). 
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General mitigation measures outlined in the EIS such as protecting wetland areas near a new 
runway must be implemented before the action can occur. General AIP funds are used for tins. 
Noise mitigation measures must also begin and continue even after the action occurs. Part 150 

funds may be used for this. 

12. Construction (Construction can last two or more years). 

13. Completion of project and beginning of change in operations. 

The actual change in operations may be marked by special public events or may occur with 
relatively little publicity. The change in operations may be slowly phased in over a period of time. 


- 41 - 


5.0 ESTIMATING ABRUPT CHANGE EFFECTS: DEMONSTRATION ANALYSIS 


This section estimates the effect of a change in noise exposure by analyzing the data from two 
surveys of residents’ reactions before and after a change in noise environments. A search was 
conducted to locate all data sets with information about changes in noise reactions. No data sets 
were found that provide strong information about reactions to changes in aircraft noise. The two 
data sets that are analyzed here, however, were constructed so that their analysis demonstrates the 
analysis methods that could be used for a new abrupt change study. 

5.1 Identification of data sets 

Appendix B describes the extensive search that was undertaken to obtain the original individual 
respondent data from social studies of reactions to changes in noise exposure. As a result of that 
search it was concluded that none of the studies for which the original survey data sets are still 
available provide a strong basis for estimating the parameters of an abrupt change model for 
aircraft noise when there has been a permanent change in noise. The absence of such information 
is largely explained by fact that the studies were designed for other purposes. The studies may 
have been quite successful in achieving their original goals even if they did not answer the 
questions posed in this report. 

The strongest road traffic surveys have studied conditions in which the change in noise, usually a 
reduction, is created by a substantial reduction in the volume of road traffic on local streets 
(UKD-237) or by other road traffic control measures that would substantially changed the danger 
or inconveniences caused by road traffic(GER-246) (Kastka, 1980: Kastka, 1981). These road 
traffic surveys do not provide satisfactory estimates for aircraft noise changes both because noise 
levels were generally reduced and because the associated changes in the road traffic could easily 
influence respondents’ judgements about the road traffic noise. The best known studies of 
reactions to changes in aircraft noise are studies of temporary changes in aircraft exposure due to 
runway repairs (USA-203) or temporary military training exercises (NOR-328). Such widely 
recognized temporary changes can not be assumed to generate the same types of reactions, 
especially long-term reactions, as would be expected from permanent changes. 

Two of the temporary-change aircraft studies had a series of at least five waves of interviews that 
might be thought to provide a basis for at least examining decay effects. One study, however, 
included some study areas in which the noise exposure did not follow a simple pattern of abrupt 
change (USA-203). Instead there were several intermediate changes in airport operations during 
the study period for which the timing is not documented and the noise exposures have not been 
measured. The Norwegian military exercise survey studied reactions to a short, two-week 
military exercise and thus does not provide information about the rate of decay in reactions to a 
continuing change (NOR-328) or about the reactions to permanent changes. 
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The available studies also had a range of study design and data collection characteristics that 
limited their usefulness in other ways. All of the studies had small numbers of study areas. The 
research reported in Appendix G shows that there are large, unexplained differences between 
study areas. With only a small number of study areas (less than 15 in almost all studies) it is not 
possible to calculate sampling errors that would evaluate the precision of the survey results. 
Several data sets either did not repeat their interviews with the same respondents m the after- 
change condition or did not obtain identifiers that would have made it possible to link respondents 
across waves and thus obtain more precise estimates of changes in reactions. One study of 
changes in night-time noise environments identified only two study areas and two noise-exposure 
levels and thus could not be used to estimate the parameters of a model (USA-082). Other noise 
change studies did not use a before/after design and thus did not provide a satisfactory baseline 
for determining if there was a change in reactions that could be associated with a change in noise 

environment. 


For the purposes of the demonstration analysis in this chapter two studies were chosen that ha 
strong design features that made it possible to model changes in reactions. Both studies examined 
conditions in which there were large changes in exposure and both gathered identifiers that linke 
individuals’ responses across study waves. The two studies and some of their important 
characteristics are as follows: 


1992-93 Bod0 Aircraft Military Exercise Survey (NOR-328) 

This study measured residents' reactions before, during and after two intensive, short-term 
military exercises at the local airport(Gjestland, Liasj0, and Gran0ien, 1994; Gjestland, 
Liasj0, and Gran0ien, 1995). The generality of this study is especially limited by the fact 
that residents knew that these would be very short exercises, less than four weeks, and by 
the fact that such exercises were a periodic feature that occurred every few years in t e 
community. The study included questions about several different time periods. The 
questions about the previous four weeks’ exposure were used because the longer 
questions would have all been dominated by the standard, no-change noise exposure 
environment. Although there were six waves of interviews and respondents were asked 
about the previous four weeks, the possibilities of studying the dose-response relationships 
for four-week periods are limited. One interviewing wave was before the exercises and 
two were begun more than four weeks after the exercise periods and thus did not concern 
the change in noise. For two other "after exercise" waves the interviews were primarily 
but not exclusively, more than four weeks after the exercise. For the remaimng wave, the 
wave conducted during the exercise, more than half of the interviews were conducted 
within the first week of the start of the intensive exercise period. As a result the 
questionnaire question about the previous four-weeks concerned primarily the non- 
exercise period for many respondents. This question did not, therefore, match the only 
noise data provided in the analysis because the noise data were only for aircraft noise 
created during the intensive exercises. For the purposes of the present demonstration only 
the first wave (pre-exercise) and second wave data (during first exercise) are analyzed. 
Although this analysis is subject to the problem that the second wave analysis period does 
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not match the noise levels, it is in other respects a standard before/after analysis. 

1983-84 Southern England New Road Opening Survey (UKD-237 & UKD-297) 

This study measured residents' reactions before and after new bypass roads were opened 
that left most respondents in the towns and villages with a quieter and safer traffic noise 
environment then they had previously experienced (Griffiths, and Raw, 1986; Griffiths, 
and Raw, 1989). The generality of the study is limited by the fact that noise exposures 
decreased at all but one site. The data analysis here is drawn from the seven of the eight 
study sites with 725 interviews for which both before and after-change noise data were 
available. In some analyses the sample size is further reduced to only those respondents 
who were interviewed in both of the first two study waves. 

5.2 Analysis of the two data sets 

For these two studies three abrupt-change reaction models were examined that are simplifications 
of the more general model presented at the end of Chapter 2. The results of this analysis are 
shown in Table 1. Each of the three lines under each of the two studies represents a different 
model. 

Each analysis in Table 1 is a linear regression of annoyance on the current noise level. The 
differences between the models are in the form in which noise change is introduced. In the first 
row for each study only a novelty effect is considered. In the second row only the level- 
dependent change effect is considered. In the third row both representations of change effects are 
included. As these analyses are for only two study waves no attempt is made to estimate the 
annoyance decay term. The estimates of effects are therefore for the time of the study wave. 

The analysis has been conducted with a complex, linear, mixed model analysis computer program 
that accounts for the clustered sample and correlated responses from the same individuals (Littell, 
Milliken, Stroup, and Wolfinger, 1996). In these analyses the PSU (Primary Sampling Unit) is 
considered to be a random effect (blocking factor) that contains individuals (also random effects) 
from which repeated observations are obtained. The covariance structure within subjects is 
assumed to be compound symmetric. The study wave and noise exposure variables are 
considered to be fixed effects. 

The table contains estimates of sampling errors based on the clustered sample design. These are 
provided for purposes of illustration and discussion in this section. The actual estimates presented 
here are of little value because there were too few PSUs in each study to provide stable estimates 
(i.e. eight PSUs for UKD-237 and five PSUs for NOR-328). 

The unadjusted coefficients from the regression equations can be compared within studies, but not 
between studies because the two studies used annoyance questions with different numbers of scale 
points and scored the scales differently. For the Norwegian military aircraft study (NOR-328) the 
regression coefficient for noise exposure (BJ is seen to be rather stable across the three models. 
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For the England road traffic bypass study, on the other hand, the slope for noise level drops 
substantially from B L = 2.71 to B L = 1.57 or B L = 1.42 when a term for the increase in noise 
exposure is introduced. The negative values of the study wave coefficient (B Ww ) indicate that the 
effect of the change in exposure was to reduce annoyance below that which would be expected 
from the steady state noise exposure. In the English study, this is consistent with the expectation 
that people will overreact in the direction of the change since most respondents experienced a 
reduction in exposure. In this study the positive values for the coefficients for the level-dependent 
change variable (B^ )indicate that there is a very substantial over reaction to the change. In the 
last column of the third line, the ratio of the level-dependent change coefficient (B^) to the 
steady-state noise coefficient (B L ) indicates that after estimating the response from a steady state 
prediction model the response needs to be incremented by the equivalent of B^l.32 additional 
decibels for every decibel of change. The equation therefore predicts that if a resident 
experienced a 10-decibel decrease from 65 to 55 dB (LAeq 24hr) that the new response would 

Table 1: Coefficients from a regression of annoyance on abrupt change variables for two 


surveys 
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Study wave gives the novelty effect for interviews in a particular study wave, not the estimate of the 
novelty effect coefficient at time=0 that is represented in the decay model in Chapter 2. 
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decrease beyond that expected at 55 dB (LAeq) by the equivalent of B Ww = -6.48 dB (due to the 
novelty of the change) and the equivalent of another 13.2 dB (10 »1.32) due to the incremental 
decrease. Thus it is predicted that a resident experiencing a 10-decibel decrease to 55 dB (LAeq) 
would react in same way that residents would to steady-state noise exposures at about 35 dB (35 
=55dB - 6.48dBEAU -13.2dBEAU). 

The values of the coefficients in the Norwegian study, on the other hand, are counter to 
expectations. All of the noise change variables have negative coefficients indicating that 
annoyance decreased even though there was an increase in noise exposure. 

Although the particular values of the standard errors are, as explained above, too unstable to be of 
use for these studies, an examination of their values indicates the importance of such sampling 
errors for the evaluation of study results. The last line for the Norwegian study, for example, 
shows that neither the novelty nor the level-dependent change coefficient is statistically significant 
(p<0.05). In the “Novelty” only line for the Norwegian study the 95 % confidence interval for the 
estimated -8.21 effect extends from approximately -4 to -12 and is thus so large as to be of limited 
use for policy purposes. 

The actual analysis for an abrupt change study is likely to be complex and to involve professional 
judgment and adaptations to the data that are collected. There are likely to be additional 
modifications to the model as well as theory as a data set is examined. 

As was previously noted the novelty term in the model presented here has been assumed to 
represent a negative reaction that is associated with any change in noise level. Although it has 
been conceived of in the context of an increase in noise exposure, it might also be conceived of as 
a negative reaction that would be associated with any change in exposure (increase or decrease) 
that is due to the fact that residents are made more aware of the presence of noise. If on the other 
hand it is thought of as an overreaction in the direction of the change, then separate novelty 
effects are estimated for increasing and decreasing noise changes. 

Modeling the errors in the response process is also likely to be complex because of the presence 
of correlated variables. The noise exposure at the time of the followup interviews is likely to be 
correlated with the noise change. Of course noise levels of the PSUs differ. As a result the 
estimates of all parameters (not just their standard errors) were found to change when the multi- 
stage and repeated observation structure was recognized in the analysis. Other methods of 
calculating sampling errors such as pseudo-replication techniques might also be considered. 

Methods of dealing with analyses of non-response also needs to be explored. The current analysis 
has only included individuals who responded in all study waves. An actual analysis might not 
discard individuals that responded in a single wave and may need to explore the structure of the 
data before deciding upon the best strategy. 
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6.0 SURVEY DESIGN EVALUATION TOOL 


The purpose of an abrupt change study is to establish a basis for generalizations about future 
changes and not only to make statements about the particular sample of airports, neighborhoods, 
respondents, and interview days that are included in any specific study. Although any data set can 
estimate the parameters of a noise change model, these estimates must be sufficiently precise to be 
used in noise policy. Before conducting a survey it is therefore important to be able to predict the 
likelihood of obtaining sufficiently precise estimates of abrupt change effects. 

This chapter describes a tool that can be used to choose candidate airports, evaluate alternative 
study designs, predict the likely precision of the study results and evaluate the effects of errors in 
determining noise exposures. These predictions are produced by a computer simulation that uses 
information about the specified airports’ noise exposure environment, the noise response 
characteristics of residential populations, and alternative study designs to predict the likely 
accuracy of estimates of abrupt change effects. 

The particular tool that is presented here has been developed to evaluate a survey with one round 
of interviews before the noise change and either one or two rounds of interviews after the change. 
The technique could be easily expanded to additional rounds of repeated interviews. 

The first section of this chapter introduces the simulation method. The second section describes 
the inputs to the simulation. The following section presents the results from simulations for two 
airports. The concluding section discusses some of the limitations of this simulation model. 

6.1 A simulation-based method for evaluating a survey design 

Both conventional statistical tests for linear regression models and the types of simulation 
methods described in this chapter combine an underlying deterministic model (Aj-B,, + B L »D 
with assumptions about errors to estimate the range of outcomes that could be expected from 
samples of a given type (for example samples of size 1,000). Conventional textbook methods use 
readily available statistical theory to estimate the standard deviations of the expected samples o a 
given type based on a simple deterministic model and a very simple error structure that is 
represented by a single term (U^ drawn from one normal distribution (A i =B 0 + B l «L,+U). 
Statistical theory has been described in a previous report that extended the estimates of standard 
deviations for regression coefficients for a clustered sample design (Kalton, 1983). The abrupt 
change model presented in this report has a more complex deterministic model and the responses 
are assumed to be generated by a more complex error structure. Errors may also be present in the 
estimates of the noise levels. These errors could affect study results and bias estimates in ways 
that are not modeled by the single error term. 
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For the more complex situation presented by a noise change model, the implications of the model 
and error structure have been assessed not by developing statistical theory but rather by specifying 
the characteristics of a model, generating a large number of samples of a specified type, and then 
directly observing the extent to which these samples’ outcomes differ from one another and from 
the input model. The variations in these analyses of each sample are then characterized in the 
same way that the more conventional predictions are from standard statistical models in terms of 
the standard deviations of the parameters for samples of a specified size and design. The 
outcomes can also be compared to the input model to identify any biases. 

The outputs from any one simulation analysis for this report are the predicted standard errors of 
the parameters of the noise-change model for one sample design. For example, the baseline 
sample design for the report has a sample of 1,000 households with a specific desired allocation 
between different noise environments. The design includes one pre-change and two post-change 
rounds of interviews at each household. To determine how precise such a sample would be, the 
computer simulation program generates 100 samples of that type and measures the standard 
deviations of the 100 estimates of each of the parameters in the noise change model. The general 
outline of the process for generating 100 such samples is as follows: 

1) The population of all housing units and their noise exposures is created based on 
information about the predicted noise exposure and numbers of people in each census 
block. 

2) The sample design is read into the program and one hundred samples of 1,000 elements 
each are generated following the sample design specifications. 

3) The predicted annoyance response and response state (respondent or non-respondent) are 
assigned to each of the 1,000 dwellings in every one of the 100 samples. The annoyance 
response is predicted by starting with an underlying noise-change response model and then 
adding variability in the response that is associated with different locations, the differences 
between people’s enduring characteristics, and the differences between each individual’s 
responses on different interviewing occasions. 

4) The resulting annoyance scores are then analyzed to provide 100 estimates of the 
parameters of the noise-change model. The standard deviations of those 100 estimates are 
calculated and are reported as the predicted standard errors of the parameters for a sample 
of this type. 

5) To evaluate the effects of errors in noise measurements, the same 100 samples are 
analyzed a second time after the noise levels that were assigned to each respondent are 
modified by adding some random error. The analysis of the annoyance scores is again 
repeated and these results are compared to those from the same 100 samples that did not 
have noise measurement errors added. 

The inputs to the program that generates the samples for the simulation are described in the next 
section. 
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6.2 Inputs to the simulation 

The 27 inputs to the computer simulation are grouped into five categories in Table 2. Two of 
these categories represent constraints that are imposed either by the numbers of households 
exposed to different noise conditions (Category #1) or the variability in people s responses to 
noise (Category #4). Two other categories of inputs represent features of ctther ' ‘he acoi. 
noise survey design (Category #2) or the social survey design (Category #3) that affect the 
precision of the study. The final category consists of alternative assumptions about the 
magnitudes and structure of the abrupt change effect that determine whether the effects can be 
detected. For example, even a very weak design might be able to detect a very large e ec . 

Table 2 gives a brief description of each variable. Symbols used in Table 2 are defined in on page 
U9 of The J two columns in .he .able give .he values used in .he sm.ula..om .ha. 
are reported in the next section of the report. The baseline Simula., on .ha. appears in he tot of 
these columns is the reference point against which different study designs and assutnp tons canl be 
compared. That baseline simulation represents best estimates about the conditions 'hat cou id be 
expected for an actual abrupt change study. The baseline represents a well-de |gn ^ sanapk the 
best estimates available for the noise environments at an airport, the values of the human response 
errors to which the study would be subject and an abrupt change effect that is sufflctenffy large 
that the study should be able to detect. The “Other" column contains values that are used in other 

simulations in this report. 

The remainder of this section contains a brief discussion about each category of variables A 
more detailed description of the variables, the method for implementing the concepts and the 
rationale for choosing the values for the simulations is given in Appendix C. 

The five variables in “Category #1: Airport environment constraints” are needed to 
severe constraints that are placed on the study design by the aircraft noise exposure enviromnents 
that are available in a community and by the number of households withm each en— The 
data for these variables come from merging airport noise predictions with data on the distribution 

of the population around the airports. 

The ten variables in “Category #2: Social survey design” are the study design variables that a 
study researcher can manipulate to increase the precision of the estimates of the abrupt change 
model parameters. The sample simulation program randomly selects PSUs and, ultima y 
individuals, based on the requirements that are specified for numbers of PSUs and sample 
elements in each sample strata that is defined by the before-change and after-change noise 
e“ ents. The sample design specifications are set for each airport before the simulation is 
run. Programs have not been specially developed to suggest optimal designs. 
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Table 2: 


Inputs to the design evaluation tool for a three-phase study 



tegory #1: Airport environment constraints 


IS 

re-change noise exposure 

Estimate of DNL before the change in exposure 

13 

taise exposure change 

Change in DNL from before the change to after the change 

i 

rimary Sampling Unit 

Study area identifier (The records in the airport file are blocks 
defined for the U.S. Census) 

IS 

•lock population 

Number of people in census block 

11 

[ousehold size 

Assumed number of people per household (the population is 
divided by this number to obtain the number of dwellings) 


Base- Other 
line 


From I Same 
airport 
input 
data 




l 

is 

if 

I 


tegory #2: Social survey design 


istribution of sample 


Sample strata ID 


umber of study waves 


ays elapsed to Wave #2 (T*) 


10 bays elapsed to Wave #3 (T*) 


11 Length of each interviewing 
Iperiod 


12|Non -response follow-up design 


fave #1 response rate 


14 Wave #2 response rate 


15 jWave #3 response rate 


A matrix of sample sizes (PSUs and households) for strata 
defined by a matrix of pre-change noise exposure by noise 
change noise levels 


The identifiers for the sample strata. Sample strata are defined 
by the noise exposure matrix 


otal number of times at which interviews are conducted 


Number of days from the noise change to beginning of 
interviewing for the second study wave (e.g. first post-change 
survey) 


dumber of days from noise change to beginning of interviewing 
or the third study wave (e.g. second post-change survey) 


Number of days from first to last interview within wave #2 and 
wave #3 (interviews are assumed to be evenly distributed across 
these days) 


The study plans that determine whether non-respondents in one 
wave are dropped from the issued sample in future waves 


’roportion of sample issued for Wave #1 that responds 


Proportion of sample issued for Wave #2 that responds 
(Assumed to be the same for newly issued households. Wave #1 
espondents, and non-respondents) 


’roportion of sample issued for Wave #3 that responds (See 
Vave #2) 


Set in Same 
sample 
design 



Drop- Same 
ped 


0.80 1.00 


0.80 1.00 


0.80 1.00 
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■■ 

Name 

Description 

Simulation 

values 

Base- 

line 

Other 

Cal 

tegory #3: Noise measurement/est 

imation errors 



=1 

Error in pre-change noise levels 

Standard error of estimate of pre-change noise exposure, 
decibels 

3 

0-6 


Error in noise exposure change 

Standard error of estimate of change in noise exposure, decibels 

2 

0-6 


Category #4: Human response constraints 


“i 

’re-change response constant 

Pre-change intercept for a response/noise relationship, dBEAU 

-32 

-38 

i 

Pre-change response/slope (BJ 

Pre-change increase in annoyance for a 1 dB increase in noise 


Same 

1 

Community group effect (CT Ug ) 

Response variation at PSU level, dBEAU 

a 

B 

a 

Persistent person effect (0^) 

Stable response variation at person level, dBEAU 

14 

10 

m 

1 

Specific interview effect. 
Wave 1 (OuJ 

Response variation at interview level (0^) for Wave #1, 
dBEAU 

14 

10 

a 

1 

Specific interview effect, 
Wave 2 (OuJ 

Response variation at interview level (Ou^) for Wave #2, 
dBEAU 

14 

10 

i 

Specific interview effect. 
Wave 3 (0„J 

Response variation at interview level for Wave #3, 

dBEAU 

14 

10 

5 

tegory #5: Assumptions about abrupt change effects 



25 

Novelty change effect (V 0 ) 

Noise change increment (not level-dependent) at time T 0, 
dBEAU 

13.7 

5.5 

1 

Level-dependent change effect + 
pre-change response slope 

(Do + LO, 

Annoyance associated with increase in noise from pre-change to 
post-change at time T=0, dBEAU 

0 

6.5 

27 

Reaction decay exponent (D T ) 

The rate at which abrupt change effects decay (D x ) expressed in 
(g(B T • Ti) ) 

-0.003 

Same 


The two variables in “Category #3: Noise measurement/estimation errors” are used to introduce 
the effects of incorrectly specifying the values of noise environments. These represent the errors 
in predicting the average, long-term values of DNL for either the pre-change noise environment 
or the change in levels from the pre-change to post-change noise environment for the PSUs. All 
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sample elements in a PSU are assumed to share the same noise environment. 

The seven variables in “Category #4: Human response constraints” introduce the restraints on the 
precision of the study that are derived from a basic response model to noise that includes the 
random variations in groups’ and individuals’ responses to noise. The values of these variables 
for the simulation were determined through the analyses reported in Appendix G 

The three variables in Category #5: Assumptions about abrupt change effects” represent the 
three parameters in the abrupt change model that are input to generate the response patterns for 
the simulation. When the simulation is examined the input values and values from the simulation 
analyses are examined to determine whether there is any evidence of biases from such sources as 
noise measurement errors. The primary focus in the analysis, however, is on the extent to which 
these parameters’ variables differ for different simulated samples. 

6.3 Results from simulations at two airports 

The study design tool has been used to evaluate study designs at the two airports, Austin- 
Bergstrom International Airport and MCAS Beaufort, that were identified through the analysis in 
Appendix A as having noise environments that would provide the strongest base for a noise- 
change study. The increase in noise exposure at Austin-Bergstrom in Austin Texas was expected 
when the airport was converted to civilian use. The increase at MCAS Beaufort in Beaufort 
South Carolina was expected when additional military units would be relocated there. Although 
neither location was expecting extremely large changes, the expected changes in noise levels and 
the distribution of the population suggested that Beaufort could provide a stronger study design. 
In both locations data on population and projected noise exposures were available. At Austin- 
Bergstrom the existing values of the Day-Night Average Sound Level extended to 79 dB (about 
800 residents above 70 dB) but all members of the population were expected to have an increase 
within a narrow two-decibel range of between 3.5 to 5.5 dB. At Beaufort the existing value of 
DNL extended to 91dB (over 6,000 residents above 70 dB) with members of the population 
expected to experience from a -6 dB decrease to a +11 dB increase. Too few households were 
expected to have a decrease (less than 60 people) to be studied. The number of people with 
changes greater than 6 decibels was a little over 300. Austin-Bergstrom also had a high 
correlation (r=0.59, Pearson Product Moment Correlation) between the previous noise level and 
the expected change. At Beaufort the correlation was less than r=0.03. 

All of the simulations conducted for these two sites were similar in several respects. The initial 
sample size was set at 1,000 individuals. It was assumed that all households had four members 
and that one person was selected from each household. The response rate was assumed to be 
80% for both the initial and follow up waves. The sample was designed to create a wide standard 
deviation in both pre-change noise level and the change in noise level. Every dwelling (defined by 
a four-people-per-household assumption) was selected from the highest noise levels and the most 
extreme noise-change groups. The first wave of interviews was assumed to be conducted 
between 30 and 60 days before the noise change. The first wave of post -change interviews were 
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assumed to be conducted one year later at an average of 335 days after the change (from 320 to 
349 days). 


A critical assumption for the samples is that the responses in each census block are independent of 
all other census blocks. The sample was designed with the goal of selecting only ten people from 
each block except in the unusual, especially important noise environments where one person from 
each household (every fourth person) was selected regardless of block size. The design 
specifications were for 93 independent blocks at Austin-Bergstrom and for 99 blocks at Beaufort. 
Some blocks with less than 40 residents would yield fewer than 10 selections. This design, 
therefore assumes that the survey’s final noise measurement/estimation program could make good 
estimates for about 100 locations. 


Although any of the inputs in the model could be varied to assess an airport, the simulations 
presented in Table 3 only assess variations in the following five factors: the noise-change models, 
noise measurement errors, sample sizes, response error assumptions, and analysis models. Four 
simulations have been executed for Austin-Bergstrom and eleven for Beaufort. Two underlying 
noise change models have been generated in the data and are shown m the three panel headings 
within the table. The identical first lines in the table for both Austin-Bergstrom (“Austin- 
Bergstrom - No level-dependent effect”) and Beaufort (“Beaufort - No level-dependent effect ) 
show that the underlying response model that generated the simulation data has an intercept of 
B„=-32, a steady-state noise effect of B L =1, a novelty effect at the average interview date for the 
second wave of B Ww =5, no level-dependent change effect (B Dw = 0) and a resulting decibel 
equivalent novelty effect of 5 dBEAU. Only the last line in the table was generated with the 
second noise change model in which there is both a novelty effect (at day 335 B Ww - 2) and a 
level-dependent change effect (at day 335 B Dw = 3). 

The baseline simulation accompanied by three noise measurement error scenarios has been 
executed for both Austin-Bergstrom and Beaufort. The comparison of the input model values 
with the Austin-Bergstrom analysis #1 in Table 3 (No noise error) shows that the mean estimates 
from the 100 simulations match the model parameters given in the previous line and thus are 
approximately correct. The predicted sampling errors for these coefficients in the same line 
however, show the fundamental weakness in the study possibilities at Austin-Bergstrom. The 

predicted standard error for the novelty effect at Austin-Bergstrom is (J BWw =6.60. This large 
standard error yields a predicted 95 percent confidence interval for the novelty effect that exten s 
from approximately B Ww = -7 to +18 (5.52 ±1.96 • 6.60). The last columns express this effect in 
decibel equivalent units and provide almost the same numerical estimate of the 95 percent 
confidence interval of about B Ww /B L = -7 to +18 (5.30 +1.96 • 6.47). 
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The conclusion from the preceding analyses at Austin-Bergstrom is therefore that an initial sample 
size of 1,000 interviews with 80 percent response rates would not yield a sufficiently precise 
estimate of the novelty effect to meet the basic design criterion of detecting an effect that is the 
equivalent of a five-decibel change in steady state noise exposure (see Element #9 in Chapter 3). 
Given the small range in noise change conditions and the fact that all of the available population 
has been used from the most important noise environments it is unlikely that any sample at Austin- 
Bergstrom would give a sufficiently precise estimate. 

The examination of the effects of noise-measurement errors in the remaining lines for Austin- 
Bergstrom illustrates another weakness of this site. The “moderate noise measurement errors” 
line introduces a random error of 3decibeis (standard deviation) in the estimates of the pre-change 
noise environment and an additional random error of 2 decibels in the estimate of the change in 
the noise exposure between the two study waves. The effect of this error is to almost double the 
estimate of the novelty effect from the previous decibel equivalent estimate of B Ww =5.30 dBEAU 
to B Ww =9.96 dBEAU. This serious bias occurs because the analysis can no longer detect that 
most of the change in noise reactions between the two study waves is due to the 3.5 decibel to 5.5 
decibel increase in noise exposure. As a result the change in reactions is attributed to a novelty 
effect. This bias is especially serious because the predicted standard errors only exacerbate the 
interpretation of the study results. The sampling errors for the novelty effect are reduced and thus 
suggest that the estimated decibel equivalent effect of 9.96 is statistically significant and even 
statistically significantly higher than a B Ww =5 effect. 

The remaining two noise-measurement error simulations for Austin-Bergstrom show that the 
estimate of the novelty effect is more sensitive to errors in measurements of the change in noise 
than to errors in measurements of the pre-change noise exposure. In line 3 of Table 3 (the “large 
pre-change noise measurement errors” line) with a pre-change error of 6 decibels (standard 
deviation) gives a moderately inflated estimate of the decibel equivalent wave effect (B Ww = 6.22) 

with a large predicted standard error (O BWw =10.63). However when the 6-decibel error is 
introduced into only the noise-change measurement in line #4, the decibel equivalent effect is 
again seriously overestimated (B Ww =9.02) with misleading standard errors that would again 
indicate that this effect is statistically significantly greater than a B Ww =5 effect. 

The simulations in Table 3 for Beaufort show the effects of a fundamentally stronger study site. 
The simulation in Line #6 for Beaufort shows that the novelty effect is again estimated at about 
the correct value with an estimate of B Ww / B L =4.47 dBEAU. The predicted standard error of 

(J BWw/BU = 0.98 (95 percent confidence interval of + 1.9 dBEAU) now meets the design criterion 
of being able to detect a noise-change effect of approximately 5 dBEAU. The underestimate of 
the novelty effect in this line appears to be largely due to the miss-specification of the model in 
this analysis from including terms for both a level-dependent change effect and an novelty effect. 
When the analysis no longer includes a level-dependent term, the “novelty-only response model 
analysis” in Line #5 now provides an estimate of 4.75 dBEAU for the novelty effect. 

Two of the Beaufort analyses examine the related issues of sample size and response error 
assumptions. Although the baseline sample design starts with 1,000 selections, the 80 percent 
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response rate means that only 640 people with two interviews in both of the two waves provide 
data for all but one of the analyses in Table 3. In the single exception in Line #7 the increase in 
the sample size from 640 to 1000 (56% increase) reduces the predicted standard error for the 
novelty effect by only 11 percent (from 0.98 to 0.88 dBEAU). The optimistic response 
assumptions in Line #8, on the other hand, show that these smaller assumed response variances 
reduce the predicted standard errors by about 27 percent (from 0.98 to 0.71 dBEAU). 

The effects of noise measurements errors at Beaufort are seen to be slightly less severe, but in a 
similar direction to those at Austin-Bergstrom. At Beaufort the two-term noise change model 
used in most of this table (i.e. both novelty and level-dependent effects) for the moderate noise 
measurement error condition in Line #9, slightly decreases the regression coefficient for noise 
level (from B L =1.03 to B^O.98) while increasing the estimate of the novelty effect (from B Ww = 
4.61 to 5.81) and now giving a negative, but not statistically significant, estimate for the non- 
existent level dependent effect (B Dw = 0.01 > B Dw = -0.21). It should be noted that the increased 
errors in noise measurements only slightly degrade the sampling errors for the estimates. The 
large noise measurement errors in Line #10 (before-change error of 5 decibels and noise-change 
noise error of 3 decibels) continues the same trend toward higher estimates of the novelty effect, 
lower estimates of the level-dependent effect, and little change in the standard errors. The 
contrast between the large pre-change error condition in Line #11 (novelty effect of 5.59 dBEAU) 
and the large noise-change error condition in Line #12 (novelty effect of 7.54 dBEAU) again 
shows that the parameter estimates are especially sensitive to errors in measuring the change in 
noise level and also lead to the incorrect inference that there is a level-dependent change effect. 
The continued inflated value in the analysis with moderate noise error that includes only a novelty 
term in Line# 13 (B Ww / B L =8.22 dBEAU) shows that specifying the model correctly (e.g. only 
estimating a novelty effect) does not remove the bias from noise measurement errors. 

As with Austin-Bergstrom, sampling errors in the Beaufort data do not guard against incorrect 
inferences caused by biases in the errors in noise measurements. The sampling errors in the 
novelty effect remain small or unaffected by the noise measurement errors and lead to the 
incorrect inference that the novelty effect is significantly greater that 5 dBEAU in three of the five 
noise measurement error conditions examined here. 

Line #14 in Table 3 includes three study waves without noise measurement errors. The results 
for the second wave in Line #14 are, as expected, quite close to the results for the baseline 
simulation in Line #6. The novelty effect in the third wave of B Ww =1.75 at 685 days after the 
change is close to the input value of B Ww =1.67 that was based on the exponential decay model in 
which with V 0 =13 and B^-0.003. The standard error of 1.30 that accompanies this estimate, 
however, is too large to detect the fact that this small change effect persists after 685 days. 

The last line in Table 3 is for a simulation that includes both the novelty effect and the level- 
dependent change effect. The input values for the novelty effect (B Ww =2) and level-dependent 
change effect (B Dw =2) are closely matched by the values extracted from the simulation (B Ww =1.86, 
B Dw =2.02). The structure of the data is such however that the study design can detect the level- 
dependent change effect but not the novelty effect at the p<0.05 significance level. 
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The conclusion from the simulations in Table 3 is that Austin-Bergstrom could not provide 
satisfactory estimates of the parameters in an abrupt change model. The simulations suggest, 
however, that if the planned Beaufort changes were introduced as a single abrupt change, then a 
sample of 1,000 could, under average response variance conditions, provide an estimate of the 
novelty effect that is the equivalent of a five-decibel difference in steady-state environments. The 
simulations in the table indicate, however, that the accuracy of the estimates from the noise- 
measurement program would need to be carefully monitored to avoid biasing estimates of the 
parameters of the noise change model. 

As was stated earlier although Austin-Bergstrom and Beaufort were the strongest candidates for 
noise change study sites, neither was selected. Austin-Bergstrom, as was indicated in the analysis 
above, did not have noise environments that would support a sufficiently precise study. Beaufort, 
on the other hand, was rejected because the changes analyzed here were not in fact planned for 
implementation in a single abrupt change. As the notes in Appendix A indicate Beaufort was not 
satisfactory because the noise changes were to be implemented through a series of redeployments 
stretching over as much as a year. 

6.4 Suggestions for future use and development of the survey evaluation tool 

The scenarios in Table 3 serve as examples of the types of analyses that should be executed before 
a sample design is finalized or a decision about the selection of an airport is finalized. Although 
the baselines used here are for the best, most likely outcomes from a study, a more conservative 
strategy would be to make predictions based on pessimistic assumptions about such features as 
noise-measurement errors and response characteristics. The underlying noise environments could 
also be treated as a variable for assessment. As indicated earlier, one of the most important 
problems faced by previous noise change studies is that the noise environments were not as 
predicted. A realistic assessment of a study site should explore the extent to which slightly 
different assumptions about the population’s noise exposure affect the precision of the estimates. 

It should also be noted that the simulations in Table 3 are all for a single sample design. Other 
simulations could allocate the sample across noise levels differently. Of course the assumptions 
about noise-measurement errors should be based on an assessment of the noise-measurement 
program that was planned for a particular airport. 

The current version of this variance estimation tool contains several assumptions that are almost 
certainly incorrect. It is assumed that these assumptions do not invalidate the usage of the tool 
and that the impact of any such unrealistic assumptions is small in comparison to the uncertainty 
that is due to incorrect predictions about future airport operations. The tool could be improved 
to more realistically model responses through the following projects: 

(a) A non-linear relationship between annoyance and noise level should be modeled. The 
current program generates some negative annoyance scores. 

(b) The amount of heteroscedasticity in the annoyance responses could be examined and 
modeled. In general the variance in annoyance scores can be expected to decrease with 
decreasing noise level. 

(c) The estimates of the PSU and individual response variances might be adjusted if more 
detailed analyses of previous noise surveys indicated (as would be expected) that the 
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variance is dependent upon the size and structure of the PSUs. , 

(d'iThe sizes of PSUs should be enlarged to reflect areas over which there is dependency in 
response. (This is almost certainly larger than the small census blocks that are used in this 

(e) The^andard error for the estimate of the decay constant could be predicted if a model 
that included the decay term were included. (This would considerably lengthen the 

execution time of the simulation program.) ... 

(f) If the noise exposures are estimated from some type of noise prediction program ra er 
than from independent measurements at every study site, then the area over which single 
noise measurement errors are shared should be increased beyond the boundaries of a 


(g) In general, acousticians assessing the noise measurement difficulties at a particular airport 
should provide a more complex error structure for estimates of both the long-term 
exposure and the change in exposure. These errors might be expected to be different at 
different noise levels or locations relative to flight paths The error structure should then 

introduced into the program. . . ... 

(h) More than three survey waves of interviews could be examined. (This modification that 

would be essential if there were a serious attempt to estimate the form of the decay 


function.) 

(i) A program could be developed to determine what the optimal or 
design would be for the study airport. 


near-optimal sample 
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7.0 CONCLUSIONS AND DISCUSSION 


This report has presented a plan for designing and executing a study that can estimate the effect of 
an abrupt change in aircraft noise exposure on noise annoyance. The plan is partially based on 
new analyses that provide findings that could aid in designing most surveys of residents’ reactions 
to noise. The first stage of the plan, searching for candidate airports, was executed but no 
airports were located in the United States that met all the search criteria. This lack of available 
airports raises questions about the probability of achieving the objectives of the noise change 
project and about the definition of these objectives. 

7.1 Summary 

A study plan has been developed to estimate the effects of an abrupt, long-term change in noise 
exposure at moderate or high noise levels at airports. The statistical objective is to be sufficiently 
precise to detect a change in reactions that is as great as that due to a five-decibel difference in 
steady state noise exposure. 

The twenty-seven elements of the proposed study plan include social and acoustical surveys at the 
same airports before and after changes in noise exposure. Questionnaires for a noise change study 
were developed and pretested in communities that experienced or expected to experience abrupt 
changes m aircraft noise exposure. A program for monitoring publicity during a noise-change 
period was developed based on evaluations around three airports. A computer program has been 
developed that evaluates alternative study sites and plans for new abrupt change studies This 
study evaluation tool predicts the precision of estimates of two parameters in a noise change 

model and measures the effects of errors in noise measurements on the estimates of parameters in 
the noise change model. 

An exhaustive search was conducted to locate all satisfactory sites for a noise change study within 
the United States in 1998. On the basis of simple criteria all but two sites were eliminated as 
possible candidates. The data on the population distribution and expected noise exposures were 
analyzed for these two sites using the study evaluation tool. The tool determined that one site 
could not provide sufficiently precise estimates to meet the study design criterion. Although the 
precision expected from the second site was sufficient to meet the study goals the change in 
operations at the airport was scheduled to occur gradually over a one-year period and thus would 
not have provided evidence about reactions to an abrupt change. 

Although no suitable site was found for a study in 1998, the study plans, questionnaire, and 
survey evaluation tool can be used to support a study in the future. 

7.2 Findings from supporting analyses 

The searches for useful data sets and analyses of community response surveys led to the following 
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conclusions: 


1 , No soda, survey data sets are available that could be analyzed to provide adequate 
information about residents’ reactions to abrupt changes in long-term noise exposure 

2) The season in which a survey is conducted can affect respondents’ evaluations of no.se 

3) After accounting for differences in noise exposure, residents at different sites respond 

differently. This means that accurate studies must study many sites. 

4) Individual respondents are sufficiently consistent in their responses over time that substantial 
gains in precision for a noise change study can be obtained by reinterviewmg the same 

5) Iforw'idely separated interviews, the evidence suggests that previous interviews do not bias the 
annoyance responses of panel participants. 

7.3 Reviewing study objectives 

The fact that suitable candidate airports could not be identified from an exhaustive search of all 
US airports indicates that the type of phenomenon that was specified for study is very unusual. 
This in turn raises questions about the policy significance of attempting to study unusual 

situations. 


The requirements for the study sites are that. 

1. aircraft noise is present 

2. a permanent change in aircraft noise exposure occurs 

3. the change occurs within the study period (1998) . . t . 

4. the proposed study design be sufficiently precise to detect an abrupt change effect that th 
equivalent of a five-decibel difference in steady-state aircraft noise 

5. exposures of at least 60 dB (DNL) be present for some respondents 

6. at least a five-decibel increase in noise be predicted to occur 

7. the increase must occur at one time or within less than a three-month period 

The first five requirements are basic requirements that leave little room for alterations. The last 
two requirements, however, deserve review. These two design requirements specify a five- 
decibe? increase and an abrupt change in exposure. The five-decibel increase was set because 
was the minimum that it was suspected that residents might notice and because It was large 
enough to provide some protection againsl errors in noise measurements. The abrupt change was 
specified because it can be entered into a relatively simple model and because it provides a clear 
starting point for measuring a decay in reactions. Nonetheless, information ra^tegained^m 
reactions even if these conditions were not met if the study procedures yielded sufficiently precise 
estimates. An alternative approach would be to evaluate study designs that would study the sizes 
of changes and types of changes that are most found in communities and are therefore of greatest 

importance for policy. 

Careful consideration should be given to an alternative approach that starts, as did this project, 
with an identification of all proposals for aircraft operation changes that would change noise 
exposur^This approach would then involve a detailed analysis of each change situation in terms 


- 61 - 



of such salient characteristics as size of change, length of implementation, amount of public 
concern and importance of change for aircraft operations. From the present review of airport 
change plans, it appears that such an analysis would reveal that large abrupt change situations are 
so rare as to not be of great policy relevance. A social survey plan would then be developed that 
studied the most often observed types of changes that evoke public controversy. Such a survey 
plan would be evaluated using the tools developed in this report to evaluate its expected 
precision. Although there might be little likelihood that the parameters of an abrupt change model 
could be estimated, such a study might be able to determine whether the small observed changes 

do or do not generate annoyance reactions that are the equivalent of a five-decibel steady state 
effect. 
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APPENDIX A: IDENTIFICATION AND SCREENING OF ABRUPT CHANGE STUDY 

SITES 

This appendix describes the initial search and evaluation of candidate airports for a noise change 
study. These evaluations represent the implementation of the first element of the research plan 
(see Section 3. 1.1.1 on Airport selection and evaluation). This search was undertaken in 1997. 
The search located two pretest airports and two airports for detailed analyses. It was determined 
that no satisfactory airports were available for a noise change study at that time. As a result of 
this search project several sources of information for airport searches were identified, methods for 
evaluating airports were developed and a list of candidate airports was developed. 

A.1 Introduction to procedures 

As part of the process of quantifying the effect of abrupt noise level changes on annoyance it was 
necessary to identify airports that might experience sudden changes in noise levels in the near 
future. Airports were considered as candidates if there were plans for any of the following: a 
new or extended runway, a new or expanded terminal, a new air carrier, a reassignment of military 
aircraft, a sudden increase in operations, new flight procedures, conversion from military to 
civilian use, or a change in the engine types for aircraft. Three rounds of analyses were 
conducted. 

In the first round of analysis a list of candidate airports was developed and information was 
gathered about candidate airports. A brief screening procedure determined that most of the listed 
airports would not be suitable candidates, primarily because the changes were expected to occur 
outside of the study’s 1997-98 time frame. 


In the second round of analysis the successfully screened airports were evaluated. Two airports 
were identified as satisfactory sites for pretesting study procedures and questionnaires (Memphis 
and Dallas/Fort Worth). Site visits were made to these airports. 

The third round of analysis consisted of the combination of methods described below. Two 
airports were identified as the most promising study sites (Austin-Bergstrom and MCAS 
Beaufort). A detailed analysis was conducted of the current aircraft noise exposure and the 
planned, post-change exposure. These data provided one of the inputs for the evaluation tool 
described in Chapter 6. 

Each candidate airport was analyzed based upon specific selection criteria. Brief investigation of 
most airports and air bases was sufficient to determine that they would not be suitable for the full 
study. The remaining candidate airports were evaluated further using a combination of methods 
described below. Two airports were identified that served as satisfactory candidates for further 
study. For each of these two airports a detailed analysis of noise levels before and after the 
anticipated abrupt change was performed. 
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A.2 Forming a list of candidate airports 

A list of airports that received funds through the Airport Improvement Program was obtained 
from the FAA Headquarters. This document presented the level of funding and the proposed 
project for each of the years 1994, 1995, and 1996. This list was sotted by the type of work 
proposed. Airports which received funding for construction of new runways, new or e^anded 
terminals, or runway extensions were considered either as pre-test candidates or » fotum rtange 
candidates. Since it takes several years to complete major construction projects, a list of projects 
funded in 1994, 1995, and 1996 would include most projects that would be completed in 1 

A list of responses to the National Resources Defense Council’s National Airport Survey 
conducted in the spring and summer of 1995 was obtained. This document presented expansion 
plans, the anticipated completion date, and the status of the Part 150 Study of many civil airpo . 
Airports proposing to build or extend runways or build new or expanded terminals were studied 

further. 

Over the course of this study various FAA, military, and airport personnel were contacted. 
Personnel in the organizations noted below were most instrumental in providing information. 

FAA personnel contacted were in the FAA Airports Environmental Division in Washington, D.C. 
as well as in the various Airport District Offices (ADO) associated with the subject airports. 
Military personnel contacted were usually environmental program managers in the Air Force and 

Navy. 

Navy personnel were usually contacted regarding Naval and Marine Corps Air Stations. 

Regarding Air Force Bases we contacted the Air Force Center for r Environmental Excellence 
( AFCEE) Air Force AICUZ Major Commands including the Air Mobility Command (AMC) an 
^Smbafcoland (ACC), Headquarters Air Force (HQ USAF/1LEVP), and the NASA- 
Langley Research Center. Regarding Naval and Marine Corps Air Stations we contacted Naval 
Facilities Engineering Commands including the Southwest D.vis.on (SW DIV), ^Chesapeake 
Division Engineering Field Activity (CHES DIV/EFA), the Atlantic Division (LANT DIV), and 
the Southern Division (SOUTH DIV). Through many discussions with personnel in these military 
organizations a fairly complete list of candidate bases was developed. 

Information gathered from these sources is presented in Tables 4 and 5. All civil airports 
considered in the study are listed in Table 4. All military air bases and air stations considered are 
included in Table 5. The location of the airport, the expected change, the basis for exclusion, and 
the source of evidence for exclusion are presented in Tables 4 and 5. The expected changes 
usually included new runways and runway extensions. Other expected changes included ‘"creased 
operations, new air carriers, new or renovated terminals, new flight procedures, relocated aircraft, 
new airport, conversion to civil airport, the introduction of jet aircraft and other types of changes 

in aircraft. 
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Table 4: 


Civil airports evaluated 


ID #1 Airport and location I Expected change 


Basis for exclusion 


Source of evidence 
for exclusion 


Albuquerque Int’l 
Airport, Albuquerque, 
NM 

Runway extension 

Action to occur after study period; 
environmental documents not yet 
approved 

FAA personnel 

Atlanta-HartsGeld Int’l, 
Atlanta, GA 

New fifth runway 

Action to occur after study period 

Airport personnel 

Atlantic City Int’l 
Airport, Atlantic City, 
NJ 

Terminal expansion 

Action occurred before study 
period 

Airport personnel 

Bishop Int’l Airport, 
Flint, MI 

New terminal 

Action occurred before study 
period 

Airport personnel 

Blue Grass Airport, 
Lexington, KY 

New runway 

Action to occur after study period; 
environmental documents not yet 
approved 

FAA personnel 

Bloomington-Normal 
Airport, Bloomington, 
IN 

New runway 2-20 and 
introduction of jet 
aircraft 

Action occurred before study 
period 

Airport personnel 

Cedar Rapids Municipal 
Airport, Cedar Rapids, 
IA 

Runway extension 

Action will not occur 
(rehabilitation not extension) 

Airport personnel 

Charlotte-Douglas Int’l 
Airport, Charlotte, NC 

New third parallel 
runway 

Action to occur after study period 
(land not purchased as of 7/97) 

Airport personnel 

Cincinnati/Northern 
Kentucky Int’l Airport, 
Covington, KY 

Runway extension 

Action occurred before study 
period 

Airport personnel 

City of Colorado Springs 
Municipal Airport/ 
Peterson Air Force Base, 
Colorado Springs, CO 

New runway and 
terminal 

Action occurred before study 
period 

Air Force and city 
personnel 

Cobb County Airport - 
McCoIlum Field, 
Marietta, GA 

Increased operations 

Not an abrupt change; less than 5- 
dB increase 

Airport personnel 

Denver Int’l Airport, 
Denver, CO 

New airport; increased 
operations since opening 

Action occurred before study A 

period; steady number of 
operations in last year 

Airport personnel 

Detroit Metropolitan 
Wayne County, Detroit, 
MI 

New parallel runway 

Action to occur after study period > 

\irport consultants 

Fresno Air Terminal, 
Fresno, CA 

Terminal renovation ] 

Less than 5-dB increase I 

7 AA personnel 
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ID# 


Airport and location 


Expected change 


Basis for exclusion 


Source of evidence 
for exclusion 


15 Fort Lauderdale* 

Hollywood International, 
Fort Lauderdale, FL 


16 Ft. Smith Municipal 
Airport, Ft. Smith, AR 


17 Gillespie Field, San 
Diego (El Cajon), CA 


18 Grand Canyon National 
Park Airport, Grand 
Canyon, AZ 


19 Greater Rockford 
Airport, Rockford, IL 


20 Hornell Municipal 
Airport, Hornell, NY 


21 Houston Inti Airport, 
Houston, TX 


New runway 


Action to occur after study period I FAA personnel 


Increased operations I Action did not occur 


New air carrier 


New runway 


Extension of runway 7L* 
25R and expansion of 
terminal 


New runway and intro- 
duction of jet aircraft 


New runway 


Less than 5-dB increase 


Airport personnel 


Airport personnel 


Action to occur after study period Airport personnel 


22 Indianapolis Inti New runway 

Airport, Indianapolis, IN 


23 Jacksonville Inti New runway and 

Airport, Jacksonville, FL terminal expansion 


24 Kent County Inti Perpendicular runway 

Airport, Grand Rapids, realignment from 18-36 
MI to 17-35 for noise 

abatement 


25 Key West Inti Airport, Terminal renovation 
Key West, FL 


26 Lambert-St. Louis Inti New LDA flight 

Airport, St.-Louis, MO procedures 


27 Louisville-Standiford New re-oriented 

Field, Louisville, KY crosswind runway 


28 Madison-Dane County Runway realignment 
Regional Truax Field, from 3-21 to 4-22 for 
Madison, WI noise abatement 


29 Manassas Municipal New terminal 
Airport, Manassas, VA 


Insufficient number of dwellings 
affected 


Action occurred before study 
period 


Action to occur after study period; 
Environmental documents not yet 
approved 


Action occurred before study 
period 


FAAand airport 
personnel and 
review of Final EA 


I Airport personnel 


FAA personnel 


Airport personnel 
and review of Part 
150 Study 


Action to occur after study period FAA personnel 


Insufficient number of dwellings FAA and airport 

affected personnel and 

review of excerpts of 
EA and noise 
contour maps 


Less than 5-dB increase 


Action not approved 


Airport personnel 


Airport personnel 


Action occurred before study Airport and 
period consultant personnel 

and review of EIS 


Insufficient number of dwellings Airport personnel 
affected 


Less than 5-dB increase 


Airport personnel 
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ID# 


Airport and location 


Expected change 


Basis for exclusion 


Source of evidence 
for exclusion 


30 

Manchester Airport, 
Manchester, NH 

Increased operations; 
runway repair 

Action did not occur; runway 
repair to occur after study period 

Airport and study 
consultant 

31 

Manchester Int'l 
Airport, Manchester, 
England 

New parallel runway 

Action to occur after study period 

National Physical 
Laboratory 
personnel and noise 
contour maps 

32 

McCarran Int’l Airport, 
Las Vegas, NV 

Extension of runway 
7IV25R 

Insufficient number of dwellings 
affected; action likely to occur 
before study period 

Review of Final Part 
150 Study 


Table 5: Military air bases and air stations evaluated 


I ID# 


Airport and location 


Expected change 


Basis for exclusion 


Source of evidence for 
exclusion 


Austin-Bergstrom, 
Austin, TX 


Civil cargo and air carrier 
service to begin with new 
terminal and new runway 


Not excluded; see detailed 
discussion in text 


FAA personnel 


Holloman Air Force 
Base, Albuquerque, NM 


Relocation of German 
Tornadoes to Holloman 


Action to occur after study 
period 


Air Force personnel 


McDill Air Force Base, 
Tampa, FL 


Aircraft relocated to 
McDill 


Action occurred before 
study period 


Air Force personnel 


MCAS Miramar, San 
Diego, CA 


Exchange of F/A-18’s for 
F-14’s 


Action began before study 
period and will continue in 
phases 


Navy personnel 


MCAS Beaufort, 
Beaufort County, SC 


Relocation of F/A-18’s 
from NAS Cecil Field 


Not excluded; see detailed 
discussion in text 


Study consultant and 
review of preliminary 
environmental document 


MCAS Cherry Point, 
Cherry Point, NC 


Relocation of F/A-18’s 
from NAS Cecil Field 


Action unlikely to occur; 
action would occur in 
phases 


Study consultant and 
review of preliminary 
environmental document 


NAS El Centro, CA 


Location of new F/A- 
18EF’s at El Centro 


Action unlikely to occur 


Study consultant 


NAWC Pt. Magu, 
Camarillo, CA 


Location of new F/A- 
18EF’s at Pt. Mugu and 
construction of new runway 


Action unlikely to occur 


Navy personnel and 
study consultant and 
review of draft noise 
contours 


NAS Jacksonville, 
[Jacksonville, FL 


Relocation of new jet 
aircraft 


Insufficient number of 
dwellings affected 


Study consultant and 
review of EA 


10 


NAS LeMoore, Fresno, 
CA 


Location of new F/A- 
18EF’s at LeMore 


Action to occur in phases; 
action to occur after study 
period 


Navy personnel and 
study consultant 
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ID# 

Airport and location 

Expected change 

Basis for exclusion 

Source of evidence for 
exclusion 

1 

NAS Oceana, Virginia 
Beach, VA 

Relocation of F/A-18’s 
from NAS Cecil Field 

Action to occur in phases; 
may be stopped if a lawsuit 
produces an injunction 

Study consultant and 
review of preliminary 
environmental 
documents 

12 

Scott Air Force 
Base/Midamerica 
Airport, St. Clair 
County, IL 

Civil air carrier service to 
begin with new terminal 
and new runway; military 
runway use and aircraft 
will change 

Insufficient number of 
dwellings affected; action 
to occur in phases 

Review of 1991 Final 
EIS and 1996 EA and 
contact with county, 
TAMS, Labatt Anderson, 
and Air Force personnel 

13 

Shaw Air Force Base, 
Sumter, SC 

F-16 engine change 

Action occurred before 
study period 

Air Force personnel 


A.3 Selection of airports for pretesting study procedures 

Based on conversations with FAA personnel and a review of lists that ranked airports by total 
operations in 1995 and 1996 we selected candidate airports to be used as study pretest sites. 

After a more detailed analysis Memphis and Dallas-Fort Worth were selected For both airports 
the noise contours before and after the abrupt change were reviewed and detailed street maps 
were obtained. A drive-by survey was conducted to determine the number of dwellings which 
experienced increased noise exposure. Work done at these pretest sites helped refine the 
evaluation criteria, interviewing procedures, and data analysis techniques which were to be used in 
the subsequent analysis of future changes. 


A.4 Screening of candidate airports 


Tables 4 and 5 list all airports considered for the abrupt change study for civil and military 
airports, respectively. Many of the civil airports listed in Table 4 were considered as a result of 
information gathered during conversations with personnel m the organizations noted *b°ve_ 
airports for which we learned a new runway was planned are included in Table 4. If the airport 
personnel had not yet applied for AIP funding we did not include the project m Table 4 since the 
project would not be likely to be completed within ten years. Selection criteria were no t app » > e 
before listing the airports in Table 4. Most of the airports in Table 4 were quickly excluded base 
on information gathered during telephone calls to the airports. 


Each of the airports listed in Tables 4 and 5 were evaluated using the following four selection 
criteria: 


Study Period 
5-dB Increase 

Single Abrupt 

50 Dwellings 


The change was expected to occur in 1998. 

At least a 5-decibel (dB) increase was predicted for some area that would 
be within the 60 DNL contour after the change. 

Change The change was expected to occur all at once or over no more than a 
three-month period. 

At least 50 dwellings were located in the 5-dB increase area. 
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Any new abrupt change study needed to start in 1998 and thus airports with changes before or 
after 1998 were eliminated. This study period requirement was responsible for eliminating the 
greatest number of airports. New runways are planned for many airports in the years 1999 
through 2004. ' 

The 5-decibel increase requirement was included to insure that the change would be perceptible. 
A change in noise level of five decibels is commonly considered to be clearly noticeable. A 
change that is not clearly noticeable would be of little use in an annoyance study. 

The single abrupt change requirement was primarily intended to exclude airports that are only 
experiencing steady long-term growth. The single abrupt change requirement also usually 
excludes air bases and air stations that receive additional new or relocated aircraft. Newly 
manufactured aircraft do not involved a single abrupt change because they are usually delivered as 
they are manufactured at a rate of a few month. Likewise, relocated aircraft usually come in 
stages because several military units are usually involved and each is relocated at the time that 
each unit’s deployment cycle is completed. 

The 50 dwelling requirement was included to ensure that a sizeable group of residents would be 
expected to experience a moderate-sized change. The final evaluation of a site would depend 
upon identifying additional people who would experience a range of changes in noise exposure. 

A.5 Identification of two sites for detailed analyses 

Two sites were selected for detailed study: Austin- Bergstrom and Marine Corps Air Station 
(MCAS) Beaufort. Austin-Bergstrom is located in Austin, Texas. MCAS Beaufort is in 
Beaufort, South Carolina. 

Bergstrom AFB was an active military base until the early 1990's when the Air Force began 
relocating aircraft elsewhere. Mueller airport, a busy civil airport, will close and shift all 
operations to a new runway and terminal at Bergstrom. The former Bergstrom AFB became 
Austin-Bergstrom International Airport. The new runway opened for cargo operations in 1998 
and the new terminal will open in April, 1999. Although Austin-Bergstrom was subject to several 
weaknesses as a study site, it was one of the two best sites for further study. 

Weaknesses in Austin-Bergstrom as a study site include the following: 

1) The April, 1999 opening date is beyond the study period. 

2) There has not been a long time period during which flight operations have remained 
constant. 

3) Cargo operations will begin approximately one year before the anticipated date that 
commercial air carriers will begin service and the total number of cargo operations has 
increased beyond the projections. 

4) The City of Austin is likely to buy all houses within the 65 DNL contour. 

MCAS Beaufort is one of three sites originally proposed to receive relocated F/A-18 aircraft. 

The most recent plan is to locate two wings of aircraft at MCAS Beaufort and the remaining nine 
wings at NAS Oceana. However, the deployment schedule for the aircraft has not been 
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determined. There may be up to a year between the time the first F/A-18 wing is deployed and 
the time the second wing is deployed. There will be areas impacted by a 5-decibel increase 
between the present and the time when both wings are deployed. However, it is unclear exactly 

how many dwellings will be affected. 

A.6 Recommendations for future searches 

The initial lists of candidate airports were developed primarily from written documents. Most 
basic information about possible airports to study was gathered through mformrd 
with FAA personnel in Washington, D.C., and Navy and Air Force personnel. Written documen 
did not prove to be valuable for evaluating candidate airports. In researching contender airports 
most information was gathered through conversations with airport personnel, conversations with 
FAA Airport District Office personnel, and reviews of Environmental Impact Statements, 
Environmental Assessments, Part 150 Studies, and AICUZ studies. 

Airport personnel were able to provide an overview of the anticipated change, the timing of the 
change, the political climate, and the source of environmental documents. The FAA Airport 
District Offices sometimes provided additional information about the anticipated timing of events 
and a more detailed description of the anticipated change. A review of the environmental 
documents typically provided the most detailed information about the number of impacted 
dwellings and the noise level increases. In some cases it was necessary to perform site visits to 
determine the actual number of dwellings in a specific area. 

A future abrupt change study could begin by researching the civil airports and military bases 
excluded in Table 4 and 5, because the action was expected to occur after the study penod^Mos , 
though probably not all, changes that civil airport will experience m 1999 and 2000 would be 
expected to appear in Table 4. After the year 2000 it is probable that additional airports could be 
identified. By the year 2000 the information in Table 5 may be largely obsolete. The sources of 
information listed above should, however, continue to be useful for a future abrupt change study. 


- 75 - 


APPENDIX B: SEARCH FOR SOCIAL SURVEY DATA SETS 

An attempt was made to obtain all original, individual-level data sets for all surveys that could 
provide valuable information about three topics: reactions to changes in noise, effects of repeated 
interviews in panel designs, and seasonal effects on noise annoyance. Although published 
information was available about many data sets, this search attempted to locate the original survey 
data files with the combined noise and social survey data. These original data were needed to 
estimate the parameters of a noise change model or to estimate the response error structure that 
was needed for planning a new survey of reactions to noise. A large number of possible studies 
were identified, data sets were obtained for some of these, and, after processing the data, a total 

of six studies were found to have suitable data. This appendix describes the search process and 
results* 


Much of the information in this report came from analyses of those six surveys. Of course the 
report is also based on other survey data. A summary of the results from publications on seasonal 
effects is provided m Appendix E. A description of the results from an analysis of a Dutch survey 
(DLO study) is described in Appendix E but the original data set was not acquired. The 19 
studies that are used to estimate the response errors in Appendix G were acquired as part of a less 
extensive search process than the one described in this appendix. 


B.l The search process 


The initial list of candidate studies consisted of the noise-change studies identified in the earlier 
NASA report (Horonjeff and Robert, 1997) and the seasonal-effect studies identified in a larger 
study of the effects of situational variables on noise annoyance (Fields, 1992). Some of these 
studies were based on panel designs that provide information about the effects of repeated 
interviews. Other studies with panel designs were identified from an examination of a noise- 
survey catalog (Fields, 1991). In this report the studies are frequently referred to by the six- 
character identifiers that come from the catalog and were used in the previous NASA report. 

Attempts were made to expand this initial list by searching the Economic and Social Research 
Council (ESRQ data archive at the University of Essex, England for new studies, requesting any 
available data sets from the TNO data archive in Leiden, and sending E-mail enquiries to 
community noise researchers that asked about their awareness about new or other unpublished 
data sets. These searches located the six data sets that could be used for some aspects of the 
analysis for this report. Some characteristics of those studies are described in Table 8 in 
Appendix D. 


Attempts were made to obtain studies of changes to noise that were based on before/after study 
designs and all other studies in which some respondents were interviewed more than once. 
Although a few studies were excluded from consideration because they were too small, the 
general approach was to acquire all possible studies and then conduct detailed screening after they 
were obtained. In several instances studies were acquired but it was only after extensive data 
analysis that it was determined that the data were not satisfactory. The most frequent problems 
were that the identifiers on the data sets were not adequate to link respondents across study 
waves, to assign noise levels to respondents or to identify the study area from which respondents 
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came. The only general categories of change studies that were excluded from the search were 
studies of reactions to changes in noise due to the introduction of noise barriers or home 
insulation. Although a list of noise-barrier studies was compiled, no attempt was made to obtain 
the original data sets due to concerns, that are explained below, about their relevance for aircraft 
noise change. It is not certain that any large studies of noise barriers could have been obtained for 

analysis if they had been sought. 

B.2 Results from the study search process. 

The list of studies that were identified and considered for the search process are given in Table 6. 
Each study is identified by its catalog number, a short name, and the noise source that was 
studied. The primary purpose for attempting to search for the study is also given. The first sue 
studies were used in the report for either the noise-change demonstration analysis in Chapter 5 or 

the panel analyses in Appendix D. 

The remaining studies were not used in this report. In the “availability” column it is seen that an 
attempt was made to obtain most studies. No attempt was made to locate the studies that are 
marked as “Unknown”. The few studies that are marked as “Unavailable” are ones that cou d not 
be obtained even though it is believed that the data are still available. From the 1 l °“ 
available, there is no indication that these studies would provide substantially better informatio 
than the available studies about reactions to abrupt changes in aircraft noise. 
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Table 6: List of studies considered for the study search and analysis 
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APPENDIX C: DESCRIPTION OF VARIABLES IN SURVEY DESIGN EVALUATION 

TOOL 


The survey design evaluation tool was described in Chapter 6. This appendix provides a more 
detailed description of the variables that are input to the survey design evaluation computer 
program. Detailed information about each of the 27 input variables is provided in Table 7. 

The 27 inputs to the computer simulation are grouped into five categories. Each of these five 
categories of inputs is discussed in a separate section below. The discussions describe the inputs 

and in some instances, explain the source of the values that were entered into the suivey design 
evaluation simulations in Chapter 6. J B 


C.l The distribution of households and neighborhoods in noise environments 

The study design is severely constrained by the aircraft noise exposure environments that are 
available in a community and by the number of households within each environment. These 
constraints are represented by five inputs in Table 7. 

Input #/: Pre-change noise exposure: The noise exposure for the time preceding the initial 

pre-change interview wave is estimated for each residential area. 

Implementation: Noise exposure is represented by DNL in the survey design evaluation tool 
The estimates of noise exposures came from noise estimation programs that use input about flight 
operations. For Bergstrom noise contours were obtained using the Federal Aviation 
Administration’s Integrated Noise Model (INM) Version 5.1.b. For Beaufort noise contours 
were derived from the Department of Defense’s NOISEMAP Version 6.5. INM was then used to 
extract the noise exposures for the centroids for each census block. Estimates are made to the 
nearest tenth if a decibel even though it is recognized they may be imprecise. Although only DNL 
is used in the analysis, the computer file also contains the information on the total number of 
operations, distance to closest aircraft operations, and number of types of operations for each 

rAOlriantml na-AA * 


Input U2: Noise exposure change: The change in noise exposure from the pre-change 

exposure to the post-change exposure is estimated for each residential area. 

This estimate is based on the authorities’ best predictions about the future operations. This 
estimate is also to the nearest tenth of a decibel, thus the sum of the pre-change and change 
estimates provides a direct estimate of the post-change exposure, unlike the predictions that 
would be derived from grouped data with wide ranges in exposure. 
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Definitions and locations of variables used in the design evaluation computer program 
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Input U3: Primary sampling unit ( PSU ): The primary sampling unit (PSU) is the smallest 

geographical area for which data are prepared for input to the design evaluation 
program. Each PSU is a record in the input file that contains all of the airport- 
specific data. The noise measurement errors and survey response variances are 
assumed to be completely independent between PSUs. 

The PSU is a census block. The census data comes from two data sets provided by the 
Department of Census. The census population counts come from the 1990 Census of Population 
and Housing (Summary Tape File 1A produced by the Data User Services Division, U.S. 
Department of Commerce). The corresponding geographic data come from the 1995 
TIGER/Line file from the Geography Division of the U.S. Department of Commerce. In urban 
areas, a census block is often a city block. A centroid is defined for each PSU for which the noise 
exposures are calculated and at which the population is assumed to be concentrated. Variation, if 
any, in the noise exposure within each area is not evaluated and thus all elements within a PSU are 
assumed to have the same exposure. The use of the census block as the PSU will probably result 
m an overestimate of the precision of the study design because both noise measurement errors and 
individual response errors are likely to be correlated for larger areas. 

Input #4: Block population: The block population is the number of people who reside in 

the PSU. 

The population size was measured in the 1990 census and has, in some cases, been updated with 
more recent information. This can be out of date, especially around rapidly changing airports. 

The final evaluation of a study site should be based upon an updated, on-site survey of dwellings 
in at least the most critical noise exposure conditions. & 

Input #5: Household size: The block population is divided by an estimate of average 

household size to provide the estimate of the number of dwelling units upon which 
the remainder of the design evaluation exercise is based. 

It is assumed that a single selection would be made from each household. Household size was 
estimated to be four for the purposes of this simulation. This probably results in undercounting 
the number of households. Counts of households are not available on a census block level. If it 
were important to obtain more interviews in rare noise environments, then additional members 
could be added from each household. The prediction program has not, however, been designed 
to account for the reduced efficiency of such a sample. 

C.2 Social survey design variables 

The inputs in this section are under the control of the survey designer and thus can be manipulated 
to increase the precision of the study 

Input U6: Distribution of sample: The desired size and distribution of the sample is 
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specified by a matrix defined by the pre-change noise levels and the size of the 
noise change. Both the number of households and the approximate number of 
PSUs are specified. The cells in the matrix are identified as sample “strata” for the 
purposes of sample selection. Probability selection methods are used for selecting 
both PSUs and households within strata. 


The simulation program draws repeated samples based on one set of design specifications. The 
target sample size goal is always met for the total sample and the take-all-household strata. T e 
particular sample selection algorithm used in this program sometimes allocates more or fewer 
selections to particular strata than are desired due to PSUs that do not have the standard number 
of in most cases, 10 households. For samples at Beaufort one or more strata had as much as 70 
percent more allocations or as few as 30 percent of the desired size. In one sample only 12 
percent of the preferred size was allocated to one strata. 

Input #7: Sample strata ID: Each of the cells in the sample-distribution matrix is identified 

and treated as a stratum for the purposes of sample selection. 


The sample is drawn with probability selection methods. Although the analysis accounts for the 
clustering of responses into blocks, it weights all cases equally and the stratification is ignored in 

the calculation of sampling errors. 

Input #8: Number of study waves: The total number of waves of interviews is specified. 

Three waves of interviews are specified, one before the change and two after. Analyses of a 
simple, two-wave design (before/after) can be conducted with the present program. The program 
would need to be modified for more than three waves. 

Input #9: Days elapsed before Wave #2 interview: The days from the change in noise 

exposure to the beginning of the interviewing period for Wave #2 (the first post- 
change wave) are specified. 

The time from the first wave to the noise change is irrelevant since the count of elapsed days is 
only used for calculations of the decay in reactions from the time of the noise change. 

In put #10: Days elapsed before Wave #3 interview: The days from the change in noise 

exposure to the beginning of the interviewing period for Wave #3 are specified. 

Input #11: Length (days) of each interviewing wave: The interviews for each wave are all 

completed within this number of days. 

The simulation distributes the interviews randomly within a 30-day period with equal probabilities 
for each day. 
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Input *12: Non-response follow-up design: The follow-up policy for non-respondents from 

an early wave can be varied so as to include or exclude them from the issued 
sample for future waves. 

All sample members are assigned a latent response status for each wave. The follow-up policy’s 
effect is introduced by excluding certain patterns of non-respondents from the analysis The 
default is to issue all sample dwellings at each wave. This overestimates the numbers that could 
be issued in an actual survey since no attempt would probably be made to contact refusals. 

Input *13: Wave * 1 response rate: A response rate is set for the first (pre-change) wave. 

This is the percentage of the issued sampled households that yield interviews. The 
actual response rate is a function of both the response characteristics of the study 
population and the amount of resources that are devoted to response-rate 
enhancing field practices. 

The response rate is set at 80 percent for the simulation. 

Input *14: Wave *2 response rate: This is the response rate for the first post-change 

interview wave. 

The same response rate is applied to all of the issued sample in the wave. No differentiation is 
made by the response status during the previous waves. In practice, response rates for previous 
non-respondents would be lower than the response rates for previous respondents. 

Input *15: Wave *3 response rate: This is the response rate for the second, post-change 

wave. 6 

The method of implementing this input is described in Input #14. 

C.3 Noise measurement/estimation design variables 

The precision of the noise environment estimates is a potentially important feature of the study 
design. The noise estimates of importance for this study are the estimates of the average, long- 
term noise exposure at a particular residence. It is assumed that this estimate contains some error. 
For a noise measurement program at selected study sites the error is most likely to arise from the 
requirement to use only a sample of measurements to estimate the noise environment for a much 
longer period of time. If the noise is predicted rather than measured then the errors may arise 
from random errors in the input data to the program. These errors should NOT include 
deviations of individual dwellings within PSUs around the mean of those dwellings’ exposures. 

The estimates of the precision of the noise program must be developed for any particular airport 
and noise measurement/estimation strategy. The purpose of including these estimates as an input 
to the simulation program is to determine the extent to which lack of precision in the noise 
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measurement/prediction program will affect survey results. If these errors are large relative to the 
variation in noise environments found at any particular airport, the parameters of the abrupt 
change model could be both imprecise and biased. 

Input #16: Errors in estimates of the pre-change exposure: This is the standard deviation of 

the estimates of the long-term noise levels around the mean noise level for all 
dwellings that have the same noise environment. This is not the same as the 
deviation of respondents’ dwellings’ exposure around predicted values. The 
critical standard deviation is the relationship between the predicted values for PSU 
and the true mean values for those PSUs. This is an estimate of the error in 
predicting the long-term, steady state noise environment at an airport. 

Errors are assumed to be normally distributed and to be independent of each other for each PSU. 
For most actual noise-modeling programs used around airports, the errors are probably correlated 
over much larger geographical areas that are subject to the same errors in specifying flight 
operations or weather conditions. This simulation makes the assumption that these random errors 
are of equivalent size, when measured in decibels, at all locations around an airport. 

The estimates of between-individual and PSU-related response variances from previous surveys 
that are introduced in Inputs #20 to #23 will have already captured some of the effects of noise 
measurement errors on the variances of responses. The sizes or effects of those errors can not be 
removed from previous surveys’ estimates. The explicit introduction of noise measurement errors 
still helps to evaluate the effects of different levels of measurement errors on the study s 
estimates. 

Input #17: Errors in estimate of noise exposure change: This is the standard deviation of 

the errors in measuring the amount of change in the noise exposure and is related 
to the extent to which the differences between pre-change and post-change 
conditions are accurately determined AFTER the study has been completed. 

These errors could be very small if the change was quite precisely specified (for 
example a doubling of aircraft under all operating conditions) even if the estimate 
of the pre-change, long-term noise environment were imprecise. This not a 
measure of the difference between the previously predicted and actual post-change 
noise environment. 

These errors are again assumed to be normally distributed and of equivalent size (in decibels) at 
all types of locations around an airport. 

C.4 Human response constraint variables 

The precision of the survey estimates is constrained by the characteristics of residents’ responses 
to noise and especially by the patterns of variation in their responses to similar noise 
environments. All of these estimates are obtained from the analysis of previous responses that is 
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described in Appendix G. All of these estimates are expressed as a ratio of the 
the regression coefficient for noise level (i.e. dBEAU units). 


estimated value to 


Input #18: Pre-change response constant: This is the intercept term for a linear regression 

equation that predicts annoyance from noise exposure. 


The analysis in Appendix G provides a value of -32 for the baseline simulation, 
term does not affect any of the estimates that are utilized from the simulation. 


The value of this 


Input #19: Pre-change response slope: This is the number of units of annoyance that is 

associated with each decibel increment in noise level in the steady-state pre-change 
condition. 6 


This is the linear regression coefficient for predicting annoyance from noise level, R. The 
regression coefficient is measured in the annoyance units in each survey. The value is arbitrarily 
set to one for the simulation. All other human-response constraint inputs are expressed as 
multiples of this unit. 


nput #20: Response variation (PSU level): The variation in residents’ responses that is 

associated with their locations in PSUs is expressed as a standard deviation This 
variation can very substantial reduce the precision of a survey’s estimates 
especially if the PSUs are large. 

T f h l re ^f e J ari l nCe ‘ S defined 88 the wej ghted mean of the estimates of the standard deviation 
of the PSU effect from the previous noise surveys that are analyzed in Appendix G. As explained 
m the discussion of the previous input, this is expressed in regression coefficient units (dBEAU) 
The analysis in Appendix G provides a value of 7 for the baseline simulation. This indicates that 
the standard deviation of the differences between study areas (after controlling for noise level) is 
the equivalent of about 7 decibels. 


Input #21 : Response variation for individual ( constant across waves) : The variation 

associated with the characteristics of the individual that are constant over the 
course of the entire survey are represented by this standard deviation. This could 
be considered to be the consistent differences between individuals within PSUs. 
As with all measures of variation in the simulation, these error distributions are 
assumed to be normal. 

Appendix G explains how the value of 14 dBEAU that is used in the baseline simulation for the 
survey design evaluation tool was selected. 

Input #22: Response variance for Wave # 1 ; The response variance for Wave #1 is the 

standard deviation of the responses in a particular wave (Wave #1) that is not 
associated with noise level, PSU membership, or the consistent characteristics of 
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an individual. Random errors in measurements or random variations in day-to-day 
assessments of the aircraft noise would contribute to this source of variation. For 
the few studies that were examined there was no consistent pattern between the 
within individual variances for different study waves. As a result, the same value 
of 14 dBEAU is used for the baseline model for each study wave. 

Appendix G explains how the value of 14 dBEAU that is used in the baseline simulation for the 
survey design evaluation tool was selected. 

Input #23: Response variance for Wave #2: See Input #22. This variation could be greater 

than that for Wave #1 if respondents experience considerable day-to-day 
uncertainty in their evaluation of the new noise environment. 

Appendix G explains how the value of 14 dBEAU that is used in the baseline simulation for the 
survey design evaluation tool was selected. 

Input #24: Response variance for Wave #3 : This represents the same concept as the 

previous input, but is for Wave #3. 


C.5 Assumptions about abrupt change effects 

The size and form of the abrupt change effect partially determines whether a particular study 
design or analysis method can detect the effect. Three parameters are needed to specify t s 
effect The values have been chosen so that at the time of the first follow-up wave ( ave ) 
excess response would be the equivalent of a five-decibel increment in steady-state aircraft noise 
exposure. This effect was arbitrarily chosen as the smallest effect that a noise-change survey must 

be able to detect. 


Input #25: Novelty abrupt change effect: The “novelty abrupt change effect” is the change 

in reactions between the pre-change and post-change waves that occurs 
independent of the size of the change in noise level. This is the magnitude of the 
effect when that effect is extrapolated to the first day of exposure to a new noise 
condition. As this value is decayed over-time using an exponential decay model, it 
is important that this value yield realistic estimates, when decayed, for times at 
which annoyance can be measured. 


This novelty effect is assumed to affect all people in the airport community whether or not they 
actually experience an increase or decrease in the value of DNL. For the baseline ca f®’ there 1S 
assumed to be an abrupt change effect on the day of the change (T=0) of 13 dBEAU (the 
equivalent of a 13-decibel penalty). With the human response decay rate that is used, the 
magnitude of this abrupt change effect has declined to 5 dBEAU by the time of the first stu y 
wave at 320 days and to about 1.7 dBEAU by day 685 when the second study wave occurs. 
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Input *26: Level-dependent abrupt change effect on first day: The level-dependent abrupt 

change effect is the incremental increase in annoyance per decibel of increase in 
noise level that is over the increase in annoyance that would be predicted from 
steady-state relationships for the post-change noise level. This is again the effect 
that is extrapolated to occur on the first day of exposure to the changed noise 
exposure. This effect is decayed at the same rate as the novelty effect. 

The model included in the simulation program assumes that each decibel of increased noise has 
the same effect. For example the increase in reactions between the experience of a one-decibel to 
a two-decibel increase is the same as the increase in reactions between the experience with a seven 
to an eight-decibel increase. No adjustments are included in either of the abrupt change effects 
that would model a threshold for detecting changes in noise levels. A level-dependent effect is 
not included in the baseline model, but is included as one of the alternative scenarios. In this 
scenano, the value for the level-dependent effect is set at 5.5, indicating that each one decibel 
increment in abrupt change exposure is subject to an additional increment in annoyance that is 5 5 
times as great as that which would be expected from the one decibel increase itself. By the time 
of the interview at 335 days it is assumed that this value has decayed at the same rate as the 
novelty effect and thus is equivalent to 3 decibels. The total magnitude of the abrupt change 
effect at 335 days in this condition is therefore a function of both the size of the novelty effect and 
the size of the changes that were experienced. 

Input *27: Reaction decay rate: It is assumed that the abrupt change effects will eventually 

disappear over time until the reaction returns to the steady state case. A decay 
function is included in the model. The exponent, B T , for the base-e is introduced in 
the following expression in which the term *T” represents the days since the 
change in noise exposure: * T! > . The value of this expression is the 

proportional reduction in the abrupt change effect at the specified number of days 
after the noise change. 

Both of the abrupt change effects are assumed to decay at an exponential rate. The decay in the 
reaction thus is most abrupt soon after the change and decreases at a slower rate with increased 
time. The effect of alternative values for the exponent are demonstrated in Figure 1. In the survey 
evaluation simulations B T is set at -0.003. The novelty effect of 13.7 dBEAU thus decays to 
become 5 dBEAU at the day 335 [5 = 13.7 • e ( -°°° 3 * 335 >]. 
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APPENDIX D: EVALUATION OF BIAS AND PRECISION FOR PANEL SURVEY 

DESIGNS 

The review of alternative baselines for noise change studies concluded that the best study design 
is a longitudinal design in which an interview survey that is conducted around one or more 
airports before a change in noise environments is followed by one or more waves of interviews 
that are conducted at the same airport(s) after the change in exposure. The measure of change in 
reactions thus comes from the comparison of responses before and after the change within the 
same airport areas. Given such a longitudinal design a primary design decision is whether the 
second wave of interviews should be part of a panel design in which the same respondents are 
contacted a second time or whether a new sample in the former study areas should be contacted. 

D.l Panel design issues for noise-change surveys 

Panel designs have one substantial advantage for noise change surveys: they can extract more 
information about reactions to noise from a small number of people than can a non-panel design. 
As has been indicated in the text of this report, a major problem facing noise-change surveys is 
that there are usually fewer dwellings than are needed in some noise environments. The panel 
design extracts at least two interviews from each person (before and after the change) and thus 
doubles the number of interviews over those that could be obtained from the same population 1 
each unit were only interviewed once. In the absence of major weaknesses in a panel design, such 
a design is needed for those rare populations. The primary issue for a noise-change survey is, 
however, the extent to which the panel design should be extended to study areas that have large 
enough populations to provide independent samples for the before-change and after-change study 

waves. 

There are two potential advantages of expanding the number of respondents in the panel design. 
One is that panel respondents provide information about the gross patterns of changes, not only 
the net amount of change. It is therefore possible to determine which respondents react most 
strongly to changes in noise exposure. The second potential advantage is that the panel design 
can be expected to provide more precise estimates of the parameters of a noise change mode . 

The within-individual comparison that is possible with a panel design makes it possible to remove 
many of the individual sources of variation in response and thus to gain a more precise estimate of 
changes in responses. The primary survey design issue is the size of this gain in precision. The 
analyses in this appendix address the precision issue by analyzing previous panel surveys of noise 

reactions. 

Panel designs have two primary disadvantages that must be balanced against this expected gain in 
precision. One disadvantage is that panel surveys tend to be more complex and expensive to 
administer and analyze. Careful administrative procedures are required to ensure that the same 
respondents are interviewed and that their records are correctly matched. Intensive field work 
efforts are needed to avoid excessive loss in the panel size. Relatively complex analysis 
techniques must be used to account for and benefit from the correlations between individuals 
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responses in the data. These cost and complexity issues are present for almost all panel surveys 
and require careful planning. 


The second potential disadvantage is the possibility of bias from gathering all after-change data 
om only those respondents who were previously interviewed and agreed to a second interview. 
The concern is data from such individuals will give biased estimates of population parameters 
either because the noise annoyance characteristics of people who are available and will agree to be 
interviewed a second time are different from the general population or because the experience of 
having been interviewed before the change will heighten the respondents’ sensitivity to noise. 

Such biases could exist for some types of social survey topics but not for others. The analyses in 
this appendix examine the evidence from previous noise panel surveys. 

D.2 Evaluation of increased precision from a panel design for noise surveys 

At least 22 panel surveys of residents’ reactions to environmental noise have been conducted. 
Surveys that have examined the consistency of residents’ responses at different times have 
reported that these responses are consistent and have acceptably high reliability coefficients 
(Bullen and Hede, 1983: Griffiths, Langdon, and Swan,1980: Hall and Taylor, 1982). However, 
none of these publications has provided statistics to estimate the gains in precision that are 
associated with panel survey designs. The levels of reliability they report are a function of both 
the range of noise levels in the studies and the consistency of the individuals’ responses. 

To measure the increased precision from a panel design it has been necessary to conduct a new 
analysis of the data from previous noise surveys. Appendix B describes the search to identify all 
possible data sets. Six studies supplied the data that are used in the analyses in this section. 

The increase in precision associated with repeated interviews is examined through analyses of 
respondents who were interviewed in both waves of a survey. In these analyses annoyance is 
regressed on three factors: 1) noise level; 2) the interview wave; and, when there is a change in 
noise level between the two waves, 3) the size of the change in noise level. The standard errors 
for the regression coefficients for each of these three factors are then calculated under two 
conditions. Under the “panel” condition, the standard errors take into account the panel sample 
design in which each of the respondents’ answers are linked across the two waves. Under the “no 
linkage condition, the standard errors ignore the linkage between respondents’ responses in the 
two waves. The panel condition therefore assumes that there are n interviews with nf 2 

respondents. The no linkage condition assumes that there are n observations from n unrelated 
respondents. 

The data from the six studies listed in Table 8 were used for the analyses. These were the only 
available studies in which over 100 respondents’ interviews could be linked across the different 
waves of interviewing. Several other noise-change studies conducted interviews with 


- 94 - 



the same respondents in different waves but did not maintain records to link responses from the 
different waves of interviews. Each of the six studies examined in this section included some 
respondents who were interviewed in some, but not all, waves. Those respondents were excluded 
from the present analyses so that the analyses would measure the maximum gam m variance 
reduction that could be obtained from a panel design. 

The six studies listed in Table 8 provide ten related data sets for the analyses. The Canadian study 
Table 8: Six studies and pairs of study waves used in the variance reduction analysis 


Study Numb Waves Months Noise Change in noise Number of Study 
J * 1 interviews areas 


ID* erof compar- elapsed source 
waves ed 


exposure 


1 & 2 2 to 8 



Road 

traffic 


Aircraft 


Road 

traffic 


Road 

traffic 


Road 

traffic 


Decrease in most 
areas due to road 2 *315=630 
opening 


2 *184= 

None 36g 



None: noise 2 *247= 
measurements 494 
differ only 

slightly between 2 • 194= 


Sonic Small, unplanned 7= 

bonic differences ... 

boonis measured 434 


Aircraft 


Aircraft 


Aircraft 


Aircraft 


Temporary 
increase from 
military exercise 



Change in 
nighttime 


2 *227= 
454 


2 *217= 
434 


2 *222 = 
444 














Comments 


Wave #3 had less than 100 
interviews 


All respondents were asked 
about both noise sources 


No changes in noise were 
expected 


Some households had multi- 
ple interviews. Weak 
noise/annoyance 
relationship. 


The 4-week reference period 
in the question included 
some exercise noise in 
Wave #2 


The 4-week reference 
periods did not include 
military exercises 


PSU-s are very large. 
Nighttime noise change is 
small. Annoyance rating 
period was not specifred. 


I.™" . Wave ,3 was 3 1-55 bays abe, ,be 0., 
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(CAN-168) provides two data sets; one based on respondents’ ratings of aircraft noise and one 
based on those same respondents’ ratings of road traffic noise. Three other surveys with more 
than two waves of interviews provide a total of six data sets because two pairs of waves were 
analyzed from each study: the first and the second wave as well as the first and last waves (UKD- 
157, NOR-328, USA-082). Other pairs of waves from these studies could also have been studied. 
The comparison of these two sets of pairs of waves, however, might be expected to provide the 
best evidence about whether gains in variance are related to the time elapsed between waves of 
interviews. 

The descriptions in Table 8 indicate that the surveys are generally rather small with from 184 to 
315 respondents providing twice that number of interviews. The studies are all based on clustered 
sample designs with from two to 24 study areas. The number of areas are so few that sampling 
errors that account for the clustered nature of the data can not be accurately estimated. Because 
of this uncertainty the increases in precision for the panel designs have been calculated both with 
techniques that account for the design and with techniques that ignore the clustered design. 

Although these data are useful for deriving information about panel survey designs, it should be 
noted that they do not include studies of reactions to large, permanent changes in aircraft noise 
exposure. Only one study (UKD-327) includes a definite, large-scale change in exposure. This is 
a study of reactions to changes in road traffic noise when traffic was diverted from previously 
busy roads to new bypass roads around villages in England. Most of these study sites were at 
locations where the noise was reduced. A study around Los Angeles International Airport (USA- 
082) examined reactions at the time of a small change in nighttime exposure. The long-term, 
general annoyance question (the only type of question analyzed in this section) did not specify the 
time period that was to be rated. Other questions about nighttime noise in the survey that referred 
to shorter time periods did not show any effect of the change in noise exposure. In the 
Norwegian study (NOR-328) a temporary increase in noise from a military exercise started just 
before the second wave of interviewing. For this second wave interview the four-week period to 
which the annoyance question referred included both the military exercise noise and the normal 
noise environment before the exercise. However, for these interviews the noise data are only for 
the military exercise period. In the sonic boom study (USA-375) there were probably some small, 
real differences in exposure between the two phases due to unknown differences between the 
military exercise schedules in the six-month periods before each study wave. 

The results from the analyses are shown in Table 9. All of the analyses regress noise annoyance 
on noise level and study wave (a dummy variable scored 0 or 1). Pairs of analyses are compared 
in which the first analysis is for the no-linkage design and the second is for the panel design. The 
same data are analyzed in each analysis. The only difference is that in the no linkage analysis the 
responses in the two waves are assumed to be independent while in the panel analysis each 
respondent’s two responses are linked. The values in this table came from analyses in which the 
study area was not accounted for in estimating the sampling errors. These analyses were executed 
with the SAS Mixed Models programs described in Chapter 5 (Littell, Milliken, Stroup and 
Wolfinger, 1996). 
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Both the “No linkage” and “Panel” rows in Table 9 have entries for the regression coefficients an 
the standard errors of those coefficients. The last column in the table gives the percentage 
reduction (e.g. improvement) in the standard error of the estimate of the regression coefficient for 
the panel design relative to the no-linkage design. The “ % reduce o” K the d.Rerences be ween 
the standard errors for the panel design in the previous column divided by the standard error 
the no linkage design. Positive values in these cells indicate the panel design is more accurate. 
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The results are all in the same direction. In every case the panel design results in an improvement 
a decrease, in the standard errors for the estimate of the differences in reactions between waves ’ 
These reductions range from 45% to 14%. There is no clear explanation for this wide range in ’ 
reductions. The amount of the reduction does not appear to be attenuated over time in any of the 
three studies in which there was a contrast between two-week and one-month gaps between 

Table 9: Changes in standard errors associated with a panel design in six studies providing 

10 data sets & 


Study 

N of 

interviews* 

Study waves 

Design 

Results for study-wave coefficient 




Bw«ve 

Q BW.ve 

% reduce (J 


UKD-237 

630 

1 & 2 

No linkage 

-16.339 

1.985 




Panel 

-15.310 

1.709 

14% 


368 

1 &2 

No linkage 

9.931 

2.904 


CAN-168 

(Aircraft) 

Panel 

9.931 

1.811 

38% 


346 

1 & 2 

No linkage 

0.105 

2.453 



(Road traffic) 

Panel 

0.105 

1.864 

24% 


494 

1 & 2 

No linkage 

2.113 

2.384 


UKD-157 


Panel 

2.118 

1.579 

34% 


388 

1 &■ 4 

No linkage 

-0.248 

2.694 




Panel 

-0.262 

1.696 

37% 

USA-375 

434 

1 & 2 

No linkage 

-7.353 

3.167 



Panel 

- 7.367 

1.85 

42% 


454 

1 & 4 

No linkage 

-8.641 

2.265 


NOR-328 

1 IX *T 

Panel 

-8.411 

1.775 

22% 


434 

1 & 6 

No linkage 

-1.801 

2.056 




Panel 

-1.801 

1.478 

28% 

USA-082 

444 

i 

1 A 7 

No linkage 

3.64 

2.308 


1 OC jL 

1 

Panel 

3.64 

1.37 

41% 

USA-082 

388 

I 

1 & 3 

^o linkage 

3.705 

<2.596 


1 OC mJ 

3 anel 

3.705 

1.42 

45% 


* Since each person responded twice, the number of respondents is half of the number of interviews. 


- 98 - 




























































to three percentage points. 

These results clearly support the use of a panel design. It is not clear exactly how much bene® 
Ln te gat d t m.hesTdesigns partly because of the differences between surveys and partly 
because of the presence of two additional sources of uncertainty. 

One source of uncertainty is response rates. The estimates come from contrasting designs , tn 
which all individuals are re-interviewed or no individuals are re-interviewed. In praetor. ^aU 
res^ndents can not be reached for repeated interviews and, as a result, even a study that is 
committed to a panel design will have many respondents who are only mterv.ewed on . 

this measure or s y lf ^ increases in the standard errors for the noise level 

“'hTse may partially cancel the reductions gained from the wave variable for estimates of 
this ratio. 

D.3 Evaluation of bias from repeated interviews 

From a brief examination of the noise literature, it appears that most P^ 0 “ s s "^ 
interviews separated by at least one-month periods between surveys reported that 
interviews. The interpretation of these findings is 
two factors: 1) the studies generally had very small control (non-pane ) gro p ) 

are not reported in detail, 

"Z^t™. -d traffic annoyance, between the initial inte.iew and later 


- 99 - 



interviews after respondents had participated several times weekly for a month This increase was 
ppr oxi mately eqiiivalem to a three-decibel increase in noise level (Fields and Powell 1985- 34) 
Although this helicopter study did not provide conclusive evidence, the study does suggest that 
repeated interviewing with only a few days gap between interviews can increase reactkfns This 
evidence is not, however, very relevant to the more typical panel design when responders are 

^n,To7ye^ d ‘ W ° ” and ta,erviewi ”« are widely spaced over several 

This section develops better evidence about the possible bias from a panel design by conducting a 

tom SfcJto 1 wfcSff S ° Cia l SU d3ta fr ° m threC SUIVeyS - These are the three Judies 

Table 8 in which the second and later waves of interviews included a mixture of 

56611 P H 6Vi ° USly interviewed and those who had never been interviewed 
before. The extensive search reported in Appendix B discovered no other existing panel surveys 

Z eZZo ^Td r T” de “ S “ d P reviousl Hnt=™ew e d respondents could £ identified 

^ nr*' 'h S 2re eXam, " ed ‘ n ‘ hiS SeC ‘ ion h* com P ar ' n g the annoyance 
responses of the new study participants with those of the panel participants (all having previous 
interviews) within each interviewing wave. mg previous 

The descriptions of these data sets in Table 8 are supplemented by the information presented in 

rs co utlms of table 10. The “Months since previous interviews” column in Table 10 shows 

tow recently the previous interviews had been conducted. The multiple entries in the colum^ 

F^xampr hlTre e ‘ aPSe !‘ ‘’'I" 6 '" "** “ d eaCh ° f ' ,he P revious interviews, 

hor example, he previously interviewed respondents in the fifth wave of study NOR-328 had 

al ,W ° T 1 ? SiX — “** a "<* nigh, monfhs tofore 

US.A^082 hJl r W6r6 ** In TaWe 10 * is a,SO seen that although study 

USA-082 has three waves of interviews, only the third wave is examined. This is because new 

respondents were not introduced into the design in the second wave. For NOR-328 analyses of 

five waves are presented (Wave #2 through #6). In all analyses, except for Wave #6 of NOR- 

328 the comparison is between the respondents who were interviewed for the first time in a wave 

stU 2 2o W fL h 9 ' nterv *ewed in every previous wave. For Wave #6 of this Norwegian 

all fiv^on^pIbuTwa^ ‘” ,e,VleWed reSP °” den,S had tan i nterviewe tt in four rather than 

1“ b °? th , e i SeV f n 3nalySeS are P resented in remaining columns of Table 10. The 
effect of noise level has been controlled through linear regression analyses by entering noise level 
as a second independent variable in an equation that includes a 0/1 repeated interview variable 

^i=Zr ^ SC ° red °" 3 ** * ha ' eMends &om a PP rox toat<tly zero to 100 usilg a 

TT/ T r 'o a ' the midpoin,s 0fscale ca,e S° ries (Miedema ato 
Vos, 1998, 3434). The coefficient for the “Panel” variable represents the effect of being 

repeatedly interviewed. To normalize these scores for differences in the regression coefficients 

.rJlTraMed“B ““tT ^ "* aPPr ° pria,e * 

Units (dBEA^a, d i„^“ ” ln ‘ he dedW E “* 
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The seven analyses in Table 10 do not prov.de evidence for a ' c °“£ en * 1 8 * show 

repeated interviewing. The negative signs for the panele Th ep osi“esigS for the 
thLt in these analyses annoyance decreases w.th repeated tntervte^a^ The post 1° ^ 

three remaining analyses indicate the opposite. esiz decibels. The estimates 

ranging from effects that are the equivalent of about -4.5 decibels to +" h 

quadratic regressions. 

The surveys do not differ sufficiently in their quality as to suggest that any one ^ re ’^ s “ ngS 
on the panel «Mb' ™ di."onI' of Sudtete' “a carefully balanced 
^gtlnLfeh^iw ^ndemsfnd pane, resU- All studies repeated ,1 heir r firet -wave 
££1 question in their later interviews. £2* 

- — — 

Table 10: Three studies with seven comparisons between new and previously-interviewe 

respondents 


Study ID Wave Months since Number of 
analyzed previous interviews 
interviews 


Results from linear regression with two terms B P WBj. 
Bo l BpANEL I O BpANEL 


USA-375 


USA-082 



NOR-328 


new=296 

panel=218 


<1, <2 new=232 

panel=154 


new=430 
panel =205 


1-2 new=405 

panel=164 


new=253 

panel=114 


2 -6-7-8 new=352 

panel=97 


6 4-6-10-11-12 new=388 

panel =95 












































analyses from this study, none of which is statistically significant two show • . • 

■~c, easing annoyance while ,wo S Ik,w repeated ime^ieSg^ctg llyance 

D.4 Conclusions 

The ev^ence reviewed in this appendix provides topic-specific information about variance 
uction and bias attributable to panel designs in community noise surveys. When combined 

ith towteclge a ^L Ut thC general princip,es of panel surve y design, the information provides a 
asis for choosing between a panel or non-panel design for community noise surveys. 

LttsTlim^, inCreaSCS thC Pre ? i0D ° f CStimateS of differences between the responses at two 
points in t me. For some surveys the increase in precision from repeated interviews was estimated 

The greater than t J at which ^uld otherwise be gained with more than a doubling in sample size 

con fi 77 ^ h fr PrOVement " thC V3rianCe fr ° m repea *ed interviewing can ™t T 

di^^ 

— 

renewed 'hereof ZVZSF , °, in,rodu “ bias •"<= results for the conditions 

The keif f f H SK ,nterv,ews and interviews that are at least one month apart 

Ld t k ° fCOnS ' Stency over the surve y s on tWs finding suggests that some caution is needed’ In 
wlfh mfn CV, f e f Ce 01 thC previous, y- cited helicopter survey indicates that a panel survey 

"« ntemeWS SePamed by ^ ra ' her ‘ han ^ Crea,C ““ ta 

JhTnfed 3 anaiyZed here indicate that a P anel design would strengthen a survey of reactions to 
nged noise environments. Any design should, however, also include additional non-panel 
respondents in follow up waves. The use of some non-panel members is especially important if 
interviews are conducted at closely-spaced intervals of less than a month. ? 
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APPENDIX E: EXAMINATION OF EVIDENCE FOR SEASONAL EFFECTS ON 

annoyance 

ofwithin-study controls i. is necessary to etther know tta t atasonr « « P 

or be able to sufficiently accurately estimate seasonal effects so that these effects 

from an abrupt noise change study. 

This appendix is divided intwo ^ ^ e ^ a ^u e s 'a« P eS^d 

ESS Sr^eTu=1^Sr are made fcr an abrupt 
change study design. 

The primary conclusion is that the season a. which an in^rview h 

at a year after the before-change interview or, in some conditions, 
the change in noise exposure. 

E.l Model for seasonal response effects 

This section presents a simple model in Figure 2 that links the time of year of ' 2 tno« • «"dy whh 
respondents'^answers to questions about no*e. Although that 

zs. ... -v. 

year. 

exposures. The noise exposures thus 
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It should be noted that the model for relating the four characteristics of seasonal weather patterns 
to window-opening and outdoor exposure is not obvious. It seems unlikely that there is a simple 
linear relationship. Below certain threshold temperatures almost all outdoor activities may cease 
and there may be no daytime window opening. Above certain temperatures home cooling systems 
may, in some countries, result in most homes’ windows being closed. Complex interactions and 
non-linear relationships may apply to the remaining climatic factors. Precipitation may eliminate 
all outside activities, regardless of temperature, but, for certain dwelling designs, have little effect 
on window-opening patterns. Wind velocity effects, like temperature, may include threshold 
ranges. 

The model in Figure 2 also suggests that other variables could affect the strength and timing of a 
seasonal effect. Various permanent characteristics of the dwelling and the surrounding area set 
limits on the extent to which noise exposure during the year can be varied by opening windows 
and by outdoor exposure. Dwelling design is relatively unimportant for the open window noise 
condition. However homes with relatively ineffective closed-window sound insulation will be 
subject to less indoors seasonal variation than homes with substantial sound insulation. The 
presence of an air conditioning system gives the option of cooling homes during warm times and 
thus of reversing the general tendency toward more open windows and less attenuation at higher 
temperatures. The presence of outdoor gardens or balcony areas increases the possibilities for 
outdoor exposure. 

Cultural patterns can also be important. In some countries a value is placed on fresh air. 

Windows may be opened for at least a short time most mornings or windows may almost always 
be opened at night in sleeping rooms. Countries and regions can also differ considerably in 
whether activities such as eating or talking with friends occur out-of-doors in warm weather. 
Economic conditions may also be important. In energy-conscious locations individuals may be 
more likely to open windows to regulate inside temperatures. Some portion of the population 
may restrict window opening and outdoor activities because of either natural irritants (e.g., 
pollen) or poor perceived air quality. 

Individual differences can, of course, affect all aspects of noise exposure and annoyance. 
Individual differences directly affect noise exposure through individual preferences for window 
opening and out-of-doors usage patterns. In addition the variations in the values placed on 
different types of activities could affect the importance of out-of-doors activities and the relatively 
importance given to noise exposure at different times of day. Of course, individual differences 
can als o directly affect the daily annoyance. 

One of the most important aspects of a seasonal effects model for a noise change study is the 
length of the period that affects responses. The wording of the question may have some influence 
by asking respondents to consider a particular period. However, it should not be assumed that 
respondents will simply disregard all salient experiences at other times. It is not at all clear what 
model should be adopted. If respondents do not give special emphasis to their most recent 
experiences, then there would be no seasonal effect. If respondents’ answers to a question were 
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weighted by the recency of experiences then there would probably be some type of decay effect 
with the most recent experiences having the greatest effect but earlier experiences also being 
important. Although many aspects of memory might be expected to be subject to some type of 
exponential decay, it is not clear that judgements of annoyance should be subject to such effects. 
Long-term residents have experiences over many years that have directly provided a basis during 
all times of year for forming a judgment. New residents might correctly judge from past 
experiences that the noise exposures they experience will increase if their windows are opened or 
they participate in outdoor activities. 

The model does not explicitly address other factors and assumptions. For example, it is assumed 
that the noise emission patterns are relatively constant over the year. Although there are some 
local areas in which there are large variations in seasonal traffic, it seems unlikely that most 
variations will be of much importance especially if it is assumed that energy-based noise models 
are correct. In these models even a doubling of the numbers of events results in only a three- 
decibel increase in noise level. 

The model also assumes that seasonal climatic conditions do not have more general response 
effects. Thus it is assumed that if weather affects people’s moods and their outlook on life these 
do not in turn affect the extent to which respondents give positive or negative answers to noise 
annoyance. As the next section shows the Netherlands data provide some support for this 
assumption. 

E.2 Evidence from the Continuous Life Information Survey (DLO) 

The strongest evidence about seasonal effects comes from the year-round Continuous Life 
Information Survey (DLO) that has been conducted for more than a decade by the Central Bureau 
of Statistics in the Netherlands. This survey has included questions about noise annoyance since 
at least April 1989. The present analysis is based on seven years of data (January 1990 to 
December 1996). The data are especially valuable because the DLO survey is conducted on a 
continuous basis with a new nationally-representative sample (18 years of age and older) being 
studied every four weeks. Even though noise-exposure levels are not known, the fact that there is 
a nationally representative sample means that the same study population with only random 
differences in noise exposure is studied far each season. (This assumes that there are not 
important differences in seasonal noise emission levels.) For this seven-year period the questions 
remained similar with revisions being made at only one point, in January of 1994. 

The basic annoyance questions are given in English in Table 11. The full wording of the questions 
in Dutch is given in Table 15 in Appendix F. 

The percentages reporting three frequencies of being bothered by aircraft and road traffic noise 
are reported in Table 12 for three seasonal periods. Percentages for two other noise sources are 
reported in Table 16 in Appendix F. Each of the percentages in Table 12 is based on interviews 
conducted during four-month periods. The four-month periods are Winter (January to March and 
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SpTng^" 

that indicated that the responses in these periods were approximately simil . P 

their judgments. This would be especiaily true of respondents who were 
interviewed early in a month. 

different response rates in different population categories it is not poss.We to estimate 
sampling errors for the individual months from the available information. 

TaWe 1 1; The Netherlands DLO survey questions about noise 

I question 1 io<n I January 1994 to December 1996 



ril 199810 December 1993 January iv*. «» — 

Now I am going to mention a number of issues Now 1 a ”* SuwoSiteto knm^whether they 

tn vnu which could bother people at home. I you, of which I would like to Know wu 

would'like to know whether you are bothered by bother you tn your living environme . 

answer according to this card? Are you, in your Hying environment, bothered by: 

Are you here, at home, bothered by: 


YES 

SOMETIMES 

NO 

REFUSES/DOESN’T KNOW 


aircraft noise? ^ — _ __ 

noise from tra ins, trams, subways? 

noise from cars, lorries, motorcycles or 
mopeds? _ 

street noise , from loading and unloading? 

street noise , from playing children or young 
people? - 

noise from indu stry or businesses? 
noise from neighbors? 


Alternative 

answers 

[On show card:] 

' YES, OFTEN 
YES, SOMETIMES 
SELDOM OR NEVER 

Noise 

c) aircraft noise? 

sources 

d'l noise from trains, trams or subways? 


e) noise from cars, motorcycles or mopeds? 3. 

f) street noise , from loading and unloading , 
or from playing children ? 


g) noise from ind ustry or businesses? 

h) noise from neighbors? 

Italics indicate wording that was changed in January 1994. 


- 107 - 


differences between the winter season responses (December to March interviews) and other 
seasons are also included in Table 12. For example, the last line of Table 12 shows that there was 

P l C ' nta ^ P ° ,nt mcrease from the1990 winte r months to the 1990 summer season (June to 
September) in the percentage who chose the responses of either ‘Yes/Often” or “Yes/Sometimes” 

^ “ Seld0ra/neV ":' >- in .he las. Une of *e e„“ 

ahows that the seven-year average increase in this category from winter to summer was about 2.7 

percentage points. The comparable figure for aircraft noise is seen to be 3.0 percentage points 
An examination of the average differences for these two noise sources and their accompanying' 
easonal differences shows that there is a steady increase from winter to spring/fall to summer in 
the percentage of residents reporting being bothered. For road traffic noise there is an increase 
om win er to the other seasons for 27 of the 28 comparisons that are presented in Table 12. For 

nHh!si here ‘I 3 " increas ® for 23 of the 28 comparisons. An analysis of variance in which each 
84 months is treated as an independent observation indicates that the differences between 

effect arC StatlStiCa, ' y si g nificant at the 1X0.05 level. This evidence clearly supports a seasonal 


Several other patterns emerge from an examination of the DLO survey. The seasonal percentage 
i erences are generally larger when the base percentage annoyed is closer to 50% (for example 

onZtl i °ff for thC “f° me , Umes ” cate g°ries). This pattern adds to the concern that the fize’ 
of the seasonal effect may be related to noise level. The pattern of responses within each of the 

K^° T' 0n su Sg ests that there is a long-term trend toward decreasing numbers of people 
ing bothered. There is also a tendency for the question revision in 1994 to reduce the 
proportion choosing the middle alternative on the scale. 

One other pattern is of importance. When the annoyance with a primarily indoor noise source 
(noise from neighbors) was examined a similar seasonal pattern was not found. This clearly 
contrasts with the pattern for road traffic. To compare the seasonal differences for the two types 

WMft 6 thfee responses to the ann °yance question were first scored 1 (“Seldom/Never” or 
NO ), 2 ( Yes, sometimes” or “sometimes”) or 3 (‘Yes, Often” or “Often”). For road traffic the 
average winter score was 1.43 and the average summer score was 1.47. A similar pattern was 
present for aircraft, railway, and industrial noise. In each case each of the four summer month 
scores was higher than any of the winter month scores. For neighbor noise, however, the summer 
score was no longer higher. The average winter score was even slightly reversed with a winter 
score of .35 and summer score of 1.34. The consistency of these results suggests that there is a 
statically significant difference in the two types of questions, but this could not be directly 
tested because the individual-level data were not available for analysis. The lack of a seasonal 
response pattern for neighbor noise is important because it suggests that the seasonal response 
pattern to aircraft and road traffic noise is not due to an overall, undifferentiated response bias 
that might apply to all types of judgments during the summer or winter months. 
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Table 12: Responses and differences between responses in pairs of seasons for aircraft and 

road traffic (DLO Survey) 



jForSummcr 
* A year’s winter season includes January, 


. February, and March from the beginning of the year and December from the end of the same j 
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The analyses of the DLO data have been sufficient to establish the presence of a seasonal effect 
but not the size of that effect. Establishing the size of the effect would be difficult with the 
currently available data for the following reasons: 

1) The DLO annoyance questions measure perceived frequency of being bothered (“often 
sometimes, seldom, never”) not the degree of bother or annoyance. It is not known whether 
the two types of questions provide equivalent estimates of seasonal effects. 

The seasonal effects in this DLO data set are averaged over all noise levels, including areas 
with little or no substantial exposure. Such areas can not be separated in the analysis since 
noise levels were not measured. It is likely that the seasonal effects are greater for areas 
where the noises are clearly audible and, within those areas, in the highest noise exposure 
zones It is not possible, therefore, to determine what the sizes of the seasonal effects would 

be in the moderate or high noise-impact areas that are important for noise regulations and 
noise studies. 


2 ) 


3) The use of grouped data probably underestimates the effects of seasonal differences. The data 
that were available for the seasonal analyses reported here are the summary data for the entire 
country for each of the questions for the 84 months from 1990 through 1996. The original 
individual-level data are not available to the public for analysis. The net effect has probably 
been to underestimate the effect of climate on noise reactions. The following limitations 
would all appear to attenuate estimates of the relationships between climatic conditions and 
noise annoyance: the weather conditions on the interview day are unknown, the monthly 
interview ates do not exactly match the 4-week sampling periods: the distribution of the 
interviews within the months are not known, sampling errors could not be calculated that 
would properly account for the non-response adjusted sample weights, and the absence of 
knowledge about the location within the Netherlands meant that adjustments could not be 
introduced for regional differences in weather patterns. 

4) The response rates are low, less than fifty percent. 


E.3 Evidence from other surveys 


Tests for the presence of seasonal effects have been reported in English for at least the seven 
surveys that are fisted in Table 13. These include all six of the published tests for seasonal effects 
that were found from an extensive search of pre-1988 English-language publications from 282 

ann T nCe liSted in a noise surve y catal °g (Reids, 1991: catalog numbers 
001 to 282). Other surveys have been conducted but not published in English. For example one 

annual environmental survey in Germany (Umweltbundesamt, 1996) is reported to demonstrate 
that surveys conducted in winter months find less noise annoyance (D. Gottlob personal 
communication, 1999). The methods for evaluating the findings from the six, previously- 
identified surveys were described in an earlier publication (Fields, 1991). 

The first five of the seven studies in Table 13 report that there were greater annoyance reactions 
tor respondents who were interviewed in warm months than for respondents who were 
interviewed in colder months. The remaining two studies report no difference. The results in the 
fourth column of Table 13 show seasonal effects for the five studies that are the equivalent of at 
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least a five-percentage point difference in annoyance responses or a three-decibel difference in 
noise level. The narrative descriptions in the next-to-last column of the table document 
differences as large as 15 percentage points (USA- 143 ) or the equ, valent of fj e de ^ ^^- 
022/USA-032/US A- 044 ) . These differences are large enough to seriously distort estimates of 
noise-change effects. Most of the surveys include information about dose/response relationships 
that could, theoretically, be used to more closely estimate the decibel equivalence of the 
differences in annoyance reactions in different seasons. This has not been done due to concents 
about the effects of correlated variables and biases introduced by publication prac ices. These 
concerns are related to the conclusions drawn about seasonal effects, a minor goal for most 
surveys, and not for conclusions about the surveys’ other, usually more important, goals. 

Seasonal differences may be correlated with other factors in several studio Two, “'*£**““ 
did not explicitly control for differences in noise exposure and did not make efforts » “sure tha 
such differences were controlled or randomly distributed in the two seasons (UKD-008, CAN- 
078) For one of the remaining studies, the difference between seasons is confounded with study 
sites, since the two winter surveys were a. different ai .ports than the summer surveys (US ; A_ 
022/US A- 032 /US A-044) . In this particular case the two winter airports had been selected for 
study because they were smaller than the previously studied airports. In the analysis phase, 
however, it was realized that the observed response difference could not be interpreted because 
these two small airports were also the only ones surveyed in the winter. None of the seven 
studies were designed to average the seasonal effects for both seasons over ^eral ye^ Fwe of 
the studies base at least one of the seasonal observations on interviews from a single month wi 
the result that the effect of season is confounded with any other unrque events at that time. 

Publication practices could introduced biases if investigators reported findings when seasonal 
effects were found but failed to report their findings when no seasonal effects were four. 

Although this is a commonly recognized problem in meta-analysis (Wolf, 1986), it could be an 
esoeciallv serious problem for these surveys that were not designed to test for seasonal effects. 
Tte two surveys that were designed to test for seasonal effects (UKD-157, SPA-313) were the 
only two that did not report seasonal effects. When the list of 282 surveys that had jaelded six 
tests of seasonal effects was reexamined, it was found that an additional 12 surveys ■" the ris lhad 
interviews from different seasons that encompassed more than a six-month period, but that the 
publications had no. reported any tests for seasonal effects 

210 AUL-227 FRA-239, GER-192, GER-278, SWE-021, UKD-268, USA-059, USA-088 
USA-127, USA-129, USA-156). It is not known whether these surveys examined the possi 1 lty 

of seasonal differences. 

The seasonal findings from the 1984-85 Gandfa 3-Si.e Traffic Noise Survey (SPA-313) have not 
been thoroughly described in English and thus are presented in the remainder of this section. This 
garfish survey conducted interviews a. many of the same houses in two different summer periods 
and one winter period (Garcia and Romero-Faus, 1987). 
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Table 13: Findings on seasonal differences from seven studies 


Study 

(Catalog ID) 


1975 Schiphol/ 
Marssum and 
1975 Leeu warden 
NIPO [Aircraft]] 
(NET-115, NET- 
844) 


USA Airport [9 
Cities] (USA-022, 
USA-032, USA- 
044) 



Narrative description of 
finding 


References 


September 
compared to 
November of 
1975 (N=143) 


Istudy area 


Noise level 

(different 

airports) 


1961 Heathrow 
Aircraft (UKD- 
008) 


Summer of 
1967 (May/ 
August) & 
1969(July/ 
Nov.) compared 
to Oct. 1970 to 
Jan. 1971 
(N-8500) 


September Airport 

(N=1731) (uncertain if 

compared to Oct/Nov 

Oct. & Nov. sample is of 

(N=l 14)of 1961 same 

population) 


Distance 
from airport 


None 

(Uncertain if 
same 

population) 



1977 3-Phase JFK 
Concorde (USA- 
143) 


1972 Calgary February 

Community Noise compared to 
(CAN-078) Summer of 

1972 (N-720) 


1977 London Area Dec. 1977 to 
Panel [ROAD spring & Sept. 
TRAFFIC] (UKD- 1978 (4 waves, 
15*7) N=888 inter- 

views by N=222 

respondents) 


1984-85 Gandia Summers of 

Three-Site Traffic 1984 & 1985 

Noise Survey compared to 

(SPA-313) Winter 1984- 

85, N=543 


respondents 



(Hot, dry 
Isummer 
(>3dB) 

Annoyance is reduced by the 
equivalent of 3 dB(A) from 
September after a hot 
summer, until November 
after a wet, cool autumn. 

de Jong, 
1981:8, Fig. 
15 

[Summer 

(>3dB) 

Mean annoyance at 7 large 
city airports in summers 
(1967-69) is the equivalent 
of 5 dB greater than at 2 
small airports 1 to 4 years 
later. However annoyance 
in 4 of the 7 winter surveys 
is similar to the summer. 

Connor, 
Patterson, 
1972:31-33; 
Fields, 1983: 
966 

1 Summer 
\(>5%) 

I (Statistically 
(significant, 
[Simple random 
(sampling 
(assumption) 

2% more "Very" and 10% 
more "Moderately /Very" 
annoyed in early Sept, than 
in Oct./Nov. (Barely 
significant, p<.05 simple 
random sampling 
assumptions) 

McKennell, 

1963: 

Appendix R 

I Summer {>5%) 

At least 15% less "high" 
annoyance during the winter 
interviews. 

Borsky, 1978: 
20 

[Summer (>5%) 

At least 10% more are 
annoyed in summer than in 
February. Self-completion 
questionnaires were used. 

Dunn, Posey, 

1974:26,27 

47,48 

[No difference ] 
(p<- 05) I 

I < 

1 c 

J t 

No significant difference < 

between noise annoyance in 1 

iifferent seasons though 5 

eports of window opening ] 

lo differ. (Panel survey with 
he same respondents) 

Griffiths, 

Langdon, 

5wan, 

1980:236 

(No difference I 

(<5%) ti 

V 

n addition there is more ( 

rafific in the summer and F 

Endows are open more. F 

1 

larci'a, 
lomero- 
r a us, 1987, 
75 









The 1984-85 Gandfa Three-Site Traffic Noise Survey (SPA-313) consisted of 543 interviews at 
three sites in Gandfa, Spain. Many of the same respondents were interviewed in each of the three 
survey phases conducted in the Summer of 1984, Winter of 1984-85 and Summer of 1985. Noise 
levels were reported as being within the range of 65 to 71 dB (LAeq, 24 hr). The analysis did not 
link the responses of those respondents who were interviewed more than once. 

The data in Table 14 do not provide consistent support for a seasonal effect. When the 
percentages in the three “winter” columns (Win.) are compared with the corresponding summer 
average-response columns (S-avg.) for their respective sites, it is seen that greater annoyance 
occurs in the summer at Site #1, winter at Site #2 and either the winter or the summer, depending 
on which categories are collapsed, at Site #3. Although these data provide stronger evidence than 
those of other studies in several respects, they do not provide a definitive test of a seasonal effect. 
The sample size of 543 is small enough so that sampling errors could be important. (The numbers 
of interviews for each site-by-phase column is not reported.) In addition, the annoyance question 
differs somewhat from standard annoyance questions in one way that may effect estimates of 
seasonal effects. Two of the question alternatives suggest that the question is not about the 

Table 14: Annoyance during three seasons in the 1984-85 Gandfa Three-Site Traffic Noise 


Survey (SPA-313) 


Responses 

Site & Season 

(S=summer, Win= winter of 1984-85, S - avg.=average of two summers) 

English (translation)* 

Site #1: Avda. de la 
Republics Argentina 

Site #2: 

Paseo de Germ a nf as 

Site #3: 

Cr. deValencia 


S 4 84 

S ‘85 

s- 

Win 

S ‘84 

S ‘85 

S- 

Win 

S ‘84 

S ‘85 

S- 

Win 




avg. 




avg. 




avg. 


QUESTION: Q25 What do you think about the level of traffic noise at your home? (SHOW CARD 1) 

[Original in Spanish*- ^Como considera el nivel de ruido de trafico que Ilega a su casa? 
(PRESENTAR TARJETA 1)] 

Absolutely unbearable 

0.0 

3.3 

D 

0.0 

2.5 

24.2 

13.4 

16.2 

15.9 

a 

11.6 

5.5 

Very noisy 

IB 

6.5 

6.6 

IB 

10.0 

27.3 

18.7 

25.7 

34.1 

26.1 

30.1 

40.0 

Quite noisy 

23.3 

20.7 

22.0 

21.9 

40.0 

22.7 

31.4 

28.4 

29.5 

44.9 

37.2 

32.7 

Normal for a city like this 

633 

65.2 

64.3 

60.3 

45.0 

22.7 

33.9 

28.4 

20.5 

20.3 

20.4 

16.4 

Slightly lower than normal 

eb 

1.1 

3.9 

5.5 

2.5 

IB 

2.0 


■ 

□ 

0.7 

1.8 

This is a quiet place 


2.2 

1.1 

4.1 



0.0 




0.0 


This is an absolutely quiet 
place 

■ 

■ 

0.0 

B 

B 

B 

0.0 

B 

B 

B 

0.0 


Don’t know, not sure 

■ 

1.1 

0.6 

mm 


IB 

0.8 

1.4 

■ 


0.0 

3.6 

Total (percentages) 

100.0 

100.1 

100.1 

100.0 

100.0 

99.9 

100.0 

100.1 

100.0 

99.9 

100.0 

100.0 
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respondents’ feelings but rather about the respondents’ judgements about the noise at their house 
relative to what is “normal for a city like this” (“Normal para una ciudad como esta”). In as much 
as respondents focus on this comparison, it would be expected that the season would not affect 
how they rated their noise relative to other similar cities. Another question that asked about 
traffic noise in the city, not in the neighborhood, also failed to show a seasonal difference. 

Summer reactions were heightened at Sites #1 and #3 but not at Site #2 (Romero-Faus, 1987: 
Question 5, pp. 213, 233, 253). 

E.4 Conclusions and recommendations 

The Netherlands DLO survey has presented strong evidence that there are seasonal effects. 
However, these data are not sufficient to determine whether or not these effects would be large or 
only minor at the moderate or high noise levels that would be included in an abrupt change study 
around an airport. The remaining surveys that have been reported give mixed evidence. 

Although most surveys that have discussed a seasonal effect have reported finding a seasonal 
effect of a large size, the only two surveys that were designed to test for a seasonal effect did not 
find one. It is not known whether other surveys that have not reported a seasonal effect tested for 
its presence. 

From the examination of the existing data and considerations of the model presented in Figure 2 
the following conclusions are reached: 

1 Season of year affects noise annoyance responses under some circumstances to an unknown 
degree. The evidence is consistent with effects that would be sufficiently large to distort 
estimates from a noise-change survey. 

2 The period over which residents integrate their responses is unknown and thus methods of 
controlling for seasonal effects, other than the repetition of a survey at the same time of year, 
are uncertain. 

3 Seasonal exposure differences are probably due to differences in window opening patterns or 
outdoor usage patterns. 

4 On theoretical grounds the sizes of seasonal effects would be expected to vary greatly from 
survey to survey depending upon such factors as national or regional cultural differences, 
common dwelling characteristics and variations in seasonal climatic conditions. As a result 
findings about seasonal effects from one survey may not be generalizeable to other locations. 

5 The timing of seasonal effects could also be expected to vary greatly from survey to survey as 
a function of the same factors (i.e. national or regional cultural differences, common dwelling 
characteristics and variations in seasonal weather patterns). 

6 The best evidence on seasonal effects would come from surveys that have multiple 
observations on the same populations at different seasons over several years. Surveys with 
only one cold season and one warm season observation will confound their estimates of 
seasonal effects with any other time-related differences. 

The possibility of strong seasonal effects leads to the following recommendations: 
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The primary measure of the size of an abrupt change effect should be derived from the 
comparison of reactions at the same times of year under similar weather conditions. 

Estimates of the integration period for seasonal effects could be obtained through secondary 

analyses of the original, individual-level DLO data. 

Estimates of the decay of an abrupt change effect in the one or two months after a noi 

change may be possible if: t L 

a There are no changes or only relatively small changes in the weather conditions from the 

beginning of the integration period before the first interviews to the completion of the final 

b “f day-of-interview weather effects can be estimated through examinations of 
responses on favorable and unfavorable weather days within very short periods (i.e. 
adjacent study days) during the noise change study or during other studies. 

A new noise change survey should consider the possibility of comparing spring and autumn 
surveys that were conducted under similar climatic conditions after the noise change. 
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APPENDIX F: QUESTIONS AND DETAILED TABLES FOR DLO SURVEY 

This appendix contains additional information about the wordine ofmie.tinnn,;^ *• 
resute from the Netherlands Continuous Life Situation 8^(01^) 

F.l Wording of the DLO Questions in Dutch 

Table 15: The Netherlands DLO survey questions about noise (in Dutch) 


Part of 
question 


Wording for two survey periods 


April 1998 to December 1993 


January 1994 to December 1996 


1) INT.: Card 1 i tl 

Ik ga u nu een aanta] zaken noemen waar mensen ' 1 wto WM ' Va '' ' k 

in huia las, van tan™ hebben. ft zon graag van a last van heel, " " Jaar m “ w "'oonomgev.ng 

I willen weten of u er hier last van heeft Um a 

Wilt u antwoorden aan de band van de kaart. “ UW woonom g evin g last van: 

Heeft u hier in huis last van 


[card:] 

JA, VAAK 

JA, SOMS 


ZELDEN OF NOOIT 


|c) lawaai van vliegtuigen 

Id) la waai van treinen, trams of metro’s 

* e ) lawaai van auto’s, motoren of brommers 


f) straatlawaai van laden of lossen, of van 
spelende kinderen 

g) lawaii van industrie of bedrijven 

h) geluiden van buren 


SOMS 

NEE 

WEIGERT/WEET NIET 


1. lawaai van vliegtuigen/ 


2. lawaai van treinen, trams of metro’s/ 


3. lawaai van auto’s, vrachtauto’s, motoren of 
brommers/ 


[4. straatlawaai va n laden of lossen? 

1 5. straatlawaai van spelende ki nderen of jongeren? 
lawaii van industrie of bedrijven? 


*7. geluiden van buren? 



F.2 Detailed response data 


This section contains the complete responses for five of the basic environmental noise question 
that were included in the DLO study. The pre-1994 and post-1994 versions of the street-noise 
question are shown on different lines. 


Table 16: Detailed results from the Netherlands DLO study 


- 

— 



1989-93 Question form ! 

1994-96 Question form | 




Year j 

Year 1 


Noise |1 

source j 

'ime of year j 

Answer 

1990 | 

1 

1991 | 

1 

1992 j 

1993 j 

1994 | 

1 

1995 j 

1996 j 


Aircraft 

Winter 

Seldom/never | ]NO 

76.7% 

76.2% 

77.3% 

79.7% 

80.8% 

80.7% 

81.5% 1 



(Jan. -March, Dec.) 

Yes/. | | SOMETIMES 

17.1% 

19.4% 

18.7% 

16.1% 

14.6% 

14.4% 

12.5% 




Yes/often | |YES 

6.2% 

4.3% 

4.0% 

4.2% 

4.6% 

4.9% 

5.9% 



Spring/Fall 

Seldom/ never | |NO 

76.0% 

76.1% 

76.9% 

78.2% 

84.1% 

79.4% 

83.1% 



( Apr , May , Oct , Nov ) 

Yes/. | | SOMETIMES 

18.9% 

19.5% 

18.0% 

16.8% 

10.0% 

13.3% 

11.7% 




Yes/often | |YES 

5.0% 

4.4% 

5.1% 

5.0% 

5.9% 

7.3% 

5.1% 



Summer (Jun-Sept) 

Seldom/ never | |NO 

71.5% 

74.5% 

74.3% 

77.6% 

75.2% 

76.6% 

80.3% 




Yes/. | | SOMETIMES 

22.8% 

20.4% 

20.6% 

17.7% 

18.2% 
| 

16.6% 

13.3% 




Yes/often J |YES 

5.7% | 

5.1% 

5.1% 

4.7% 

6.6% | 

6.8% 

6.3% 


Road 

Winter 

Seldom/ never] |NO 

67.0% 

67.2% 

68.3% 

69.5% 

71.6% 

70.2% 

72.3% 


traffic 

(Jan. -March, Dec.) 

Yes/ . | | SOMETIMES 

22.0% 

22.4% 

21.2% 

21.0% 

14.9% 

15.1% 

15.9% 

— 




Yes/often | | YES 

11.0% 

10.4% 

10.5% 

9.5% 

13.5% 

14.8% 

11.9% 



Spring/ Fall 

Seldom/ never] |NO 

66.9% 

65.0% 

67.0% 

67.3% 

68.1% 

69.7% 

70.2% 



(Apr, May, Oct, Nov) 

Yes/. | | SOMETIMES 

21.9% 

23.1% 

21.5% 

22.3% 

15.2% 

14.6% 

14.6% 




Yes/often | |YES 

11.2% 

11.8% 

11.5% 

10.5% 

16.7% 

15.8% 

15.2% 



Sumner (Jun-Sept) 

Seldom/ never | (NO 

62.6% 

66.4% 

63.8% 

65.5% 

67.7% 

69.2% 

72.7% 




Yes/ . | | SOMETIMES 

23.6% 

21.7% 

23.6% 

23.0% 

14.4% 

13.4% 

14.3% 




Yes/often J | YES 

13.9% 

11.9% 

12.5% 

11.5% 

17.8% 

17.4% 

13.0% 


Railway 

Winter 

Seldom/ never | |NO 

94.7% 

94.4% 

94.3% 

95.2% 

| 95.0% 

95.0% 

j 94.9% 


(Jan. -March, Dec.) 

Yes/. | ] SOMETIMES 

3.8% 

4.4% 

3.5% 

3.3% 

j 3.3% 

2.7% 

2.8% 




Yes/often | |YES 

1.5% 

1.2% 

2.2% 

1.5% 

| 1.7% 

2.3% 

2.3% 



Spring/Fall 

Seldom/ never | |N0 

94.4% 

93.5% 

94.5% 

93.4% 

94.0% 

96.5% 

94.3% 



(Apr, May, Oct, Nov) 

Yes/ . | | SOMETIMES 

3.7% 

4.5% 

3.7% 

4.5% 

3.4% 

1.7% 

3.3% 




Yes /often] |YES 

1.9% 

1.9% 

1.8% 

2.1% 

2.6% 

1.8% 

2.5% 



Sumner (Jun-Sept) 

Seldom/ never | |NO 

94.1% 

93.6% 

93.6% 

93.4% 

93.1% 

94.0% 

95.3% 




Yes/. | | SOMETIMES 

3.5% 

4.5% 

4.1% 

4.8% 

4.1% 

3.3% 

2.2% 




Yes/often | ] YES 

2.4% 

1.8% 

2.3% 

1.8% 

2.9% 

2.6% 

2.5% 


Average 

78.6% 

16.6% 

4.8% 

78.5% 

16.2% 

5.3% 

75.7% 

18.8% 

5.6% 

69.1% 

19.6% 

11.3% 

67.5% 

19.8% 

12.7% 

| 66.4% 

| 20 . 1 % 

| 13.5% 
94.8% 
3.5% 
1 . 8 % 
94.3% 
3.7% 
2 . 0 % 
93.8% 
3.9% 
2.3% 
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(Continued) 





I 1989- 

93 Question form 


j 1994- 

96 Question form 


Nolee 

source 

JtJjbo of year 


Year 

1 Year 


j Answer 

j 1990 

| 1991 
1 

| 1992 

| 1993 
1 

j 1994 

j 1995 

| 1996 

Average 

Street 

(Children/ 

Vehicle 

loading) 

Winter 

(Jan. -March, Dec.) 

Seldom/never| J no 

86.2% 

86.2% 

86.4% 

85.3% 




86.0% 


Yea/. | | SOMETIMES 


10.7% 

10.5% 







11.2% 

. 

. 


10.6% 

3.3% 

84.4% 



Yes/often | (YES 

3.6% 

3.1% 

3.1% 

3.6% 





Spring/Fall 
(Apr, May, Oct, Nov) 

Seldom/ never | |N 0 

85.5% 

83.5% 

84.0% 

85.0% 






Yea/. | | SOMETIMES 

10.6% 

12.4% 

12.1% 

10.8% 

. 



11.5% 



Yes/often | |YES 

3.9% 

4.1% 

4.0% 

4.2% 




4.0% 

84.1% 


Summer (Jun-Sept) 

Se ldom/ never | [ NO 

82.4% 

84.5% 

84.8% 

84.3% 

. 



j 

j 

Yes/. | | SOMETIMES 

12.8% 

— 

11.0% 

11.1% 

11.0% 

. 

. 

— 

• 

11.4% 

1 

C ^ 

1 1 

Yes/often | J YES j 

4.7* 

4.4% 

4.1% 

— 

4.8% 

. 

• 


4.5% 

utifit 

(Vehicle 

loading) 

! Winter 

( J*** • -March , Dec . ) 

Se ldom/ never | | NO 


• 



93.5% 

93.9% 

93.9% 

93.8% 

3.4% 


Yes/. | | SOMETIMES 





3.7% 

| 

3.0% 

3.6% 




Yes/often | | YES 





2.8% 

3.1% 

2.5% 

2.8% 
94 . 1% 


Spring/Fall 
(Apr, May, Oct, Nov) 

Seldom/never | |no 





92.9% 

94.2% 

94.9% 


Yea/, j (SOMETIMES 





2.4% 

3.2% 

2.8% 

2.8% 



Yes/often | (YES 













4.7% 

2.5% 

2.3% 

94.7% 

3.1% 

94.1% 


Summer (Jun-Sept) 

Seldom/ never ( |no 





94.0% 

93.7% 



Yea/. | (SOMETIMES 



1 


3.2% 

3.2% 

2.5% 

2 . 9% 



Yes/often | (YES 


— 

* 1 

• 

2.8% 

3.1% 

2.9% 

2.9% 
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APPENDIX G: ANALYSIS TO ESTIMATE ERROR VARIANCES IN THE HUMAN RESPONSE 

MODEL 

Table 2) were determined from new analyses of previous social surveys. 

G.l Overview of the requirements 

1 identified the following three sources of response vartance 

for noise surveys: 

U Community Group effect: The effect of a community location on annoyance (normally 

u "m p“^t£ let of the person (those effects that are constant for the period 

within a person and group (normally distributed with mean of U ; =0) 

The relative magnitudes of these three sources of variance ^estimated in the last part of 

magnitudes of the persistent person effect and the specific in « include 

"fohe“— ;“o,«d C b'u. h .he dTects of peiten, personal differences and specific 
interview effects can not be separated. 

G.2 Information from cross-sectional analyses 

Nineteen studies are analyzed in this section that SSS" 

and residents' reactions to that noise, contatned at least 20 s* "f to e studies included both 

identifiers for those sampling units on their ortgtnal survey data rf ttoe stu 

acoustical and response data for two noise sources. As a result a total of 2 ^data se s rep * , g 

55,000 evaluations of noise are analyzed in this secttc » » d ?““^ data set is 

aircraft, 14 road traffic and 2 railway data sets that are ra rofPS Us Some of the data sets 

identified by name, noise source, number of respondent , and number of PSUs. Some 
were obtained from the TNO data archive in the Netherlands. 

To obtain the estimates in Table 17 a multi-point measure of annoyance js ^ored ^^gnted by DNL, in a 
approximately 100. This annoyance measure is then regressed on noise level, as represente y 
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these coefficients vary greatly from study to studv „ a ii ^ d ^ Vanance ofresidual scores (o^, 2 ). AH 
the sensitivity of the scales to differenriJin 7 P * y 1,603,186 the ann °yance scores scales differ and 
effect” and 4£oo LT ^ ” ay differ ' E *P^"g *• “PSU 

and expressing these in decibel Equivalent Units' (dBEAlh irffheT' 0 ." C ? efficien ‘ for noise level ( DNL ) 
for the such differences. Express! ,he« effeasin ,!!? 'r,K a “'T" 5 ° f TaWe 17 P ar,ia ">’ ad j« 
also appropriate because the 6nal results from a noise change st!Tv!iIl^ ^ u lvale ” t Ur " ts (dBEAU) is 

ratio of these two effects is shown in the last column. Tte L h! oTtL!^ ^ V man " er ' The 
effects when each study’s estimate is weiahwt h *u , of the table displays the average of the 

estimate for the PSU e^^„, 7dBEAn , '* 1 ' °i reSp0nses re P resents - ™e average 

of the two is a little over 0 3 (0 34) The next* e P erson e ff ect is about 20 dBEAU, and for the ratio 
weighted by the "* "«* * ha ' « 

sU^dlviado”°o r f SX^g fhe"f ’ ,h I PSU f haS * sutea "‘^*« o “««iot with the 
steady state noise expire 8 * eqUIVale, “ ° f « decibel difference in 

The value for Variable 20 (Response variation PSU) in Table 2 is set at 7 dBF AT I h ac h *u 
analyses. The values for the “rw D \ T 1 dBtAU based on these 

analyses of the data in Table 17 Ttet * CSp0nSe ^ SUm P tions ” scenario in Table 3 are also based on 

have response characteristics that would "v eldtT™ ^ ^ We,ghted avera S e of the seven studies that 
Table 17were Z %% T ■’"“J >U,C °” KS from a Their vaiues 

the PSU to person effect (less than 0.32). C PCrS ° n **** ^ than 21 dBEAU ) and the ra *io of 
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Estimates of response variation from cross-sectional survey designs 
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es ; i r es are k pres ? med t0 ** sufficie * for planning purposes given the large uncertainties 

. ° £ f3 ^ 0rS SU ? “ thC 3CtUal n ° 1Se ex P° sure afte r the change in operations The analyses 
that have been performed here have not folly explored the data. PSUshave been regarded! an 

H ^ °! Um CVen th ° Ugh thCy differ enormous| y from study to study In the 
vanous Heathrow studies PSUs are local neighborhoods around a single aiLrt In a number of 

LaY IlS lY " e,g ^ borhood S rou P s are spread between several airports^nd thus reflect both 
local neighborhood and atrport differences. The possibility of non-linear relationships ^ the 
response data have not been considered in this analysis. Although PSU and number-of- ^ 
respondent weights yield similar estimates, the analyses do not account for the fact that some 
surveys are counted twice, once for each of two noise sources. 

G.3 Information from panel surveys 

The person effect estimated in the previous section (O 2 =400=20 2 dBEAU) includes both the 

i:r:^r“;rr den,s ' ansvms r * due *° 

nd those additional differences associated with errors in the response process at the time of a 

P ™“' ar 'Tl pea '! d inlerviews from five studies provide a basis for dividing the 
response variance between these two sources. ® 

?:r: p r d iate ™ e y tudies PrOVide 10 data SetS for the analysis summarized in Table 18 
Two of the studies with only one repeated interview offer a single estimate, two with additional 
waves provide three estimates each, and the Norwegian study with additional waves as well as 
bvo annoyance questions, offers four estimates. Table 18 gives the estimates of the teweel 
[Krson and wtthtn-person variances. These estimates come from a regression of annoyance on 

also er ”n eVC ’ StUdy Wave (0/1 dumm y variable), and change in noise level The model 

abo provded an estimate of the PSU effect (jus. as in Table 17) that is no, included here beTause 

“; P S^ ° f PSUS for a " bUt °" e S,Udy - The i" Table 18 thus are 

The last column in Table 18 shows that the ratio of the between person variation to within Derson 
variation differs between surveys from 0.37 for the first data set (UKD-237) to 2 35 for the last 
data set. Esttmates of this ratio from simpler regression models with only noise level aid sm“v 

TnrZr ? °“ l£Vel a ”? Cha " Se in ncise level - «■"— tha, were very close to the ' 

(proportional increases or decreases of no more than 10 percent in the ratio). The average of the 
ratios (weighted by number of interviews) shows that the two variances are estimated to be about 
equal (ratio of 1.08 in the last line of the table). For the baseline estimate in Table 3 the tota! 

r::rrr f40 ° k “ to * the two sou2^tit h 

suit that the estimates of the standard deviations are 14 dBEAU (square root of 400/2). 

The estimates in Table 18 do not show a consistent pattern with respect to the number of previous 

!hltYh eWS Y r ngth ° f time that has e,apsed ***"*“ interviews As a result, it is assumed 
case). C Wl n ‘ perS ° n standard dev iation is the same for all waves (o=14 dBEAU for the baseline 


- 122 - 




Evidence on the siz e of the within-person variat ion from panel survey designs. 

11 1 1 _ . I ^ 


Study ID* I Noise source I Waves 


Between Within 




person person effect (o 2 up/0 2 u ) (Oup/Ou) 

. •? . y—2 \ 



* Additional information about studies is presented in Table 10. 

** The first two comparisons for the Norwegian survey are for a short-term (last > 

£e «»nd is for an unspecified period .b.. i. is assumed »,i. be m.erpreied 

anaiysis .bar regressed annoyame on noise leve, 

and rim C in noise level. Tbe same analysis es.ima.ed ibe random-effal va.»»e«s for PSU 
A ZZ^or a oerson and within person for study wave. The Canadian survey (CAN-168) 

in .be regression mrde, sine ibe same noise ieveis nere 


used for both study waves. 
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APPENDIX H: SOCIAL SURVEY QUESTIONNAIRE (LONG FORM) 


TIus appendix contains the standard long form of the questionnaire that is designed for 
admtnistratton one month before a noise change and, in a followup phase, one year later The 
cards to be shown to respondents follow the questionnaire. The experimental pages for the 

questionnaire appear at the end of the appendix. K 


H.l Long interview form 

T he questionnaire form in this appendix must be adapted to the local airport and noise chanee 
conditions by replacing keywords that appear in braces “{}”. The keywords are listed with the 
actual words (within quotes) that were used in the Dallas pretest 6 

{time-only} = time of change (e.g. ,“last fall”} 

{time-only2} = months since change {e.g., “the last 9 months”} 

{this-airport} = name of airport {e.g., “the Dallas/Fort Worth Airport”} 

{time-change} = description of date of change and change {e.g., “last fall when the new runway 

{change-only} = description of change {e.g., “open a new runway”} 

{change-only2} = description of change {e.g., “the new runway opened”} 

{new-change} = description of new change {e.g., “open another parallel runway”} 

{new-c ange2} - description of new change {e.g., “opening another parallel runway”} 
{new-time} = date of new change {e.g., “in about 3 years”} y * 

{paper 1} = local newspaper #1 {e.g., “the Met”} 

{paper 2} = local newspaper #2 {e.g., “the Dallas Morning News”} 

{paper 3} = local newspaper #3 {e.g, “the Dallas Business Journal”} 

{paper 4} = local newspaper #4 


The long interview form begins on the next page. 
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OMB APPROVAL NO. s 2120-0621 
Expires: 10/31/2000 

LONG-TERM SURVEY 
VERSION 1 


COMPLETE THE FOLLOWING ITEMS BEFORE BEGINNING THE INTERVIEW. 
Q2. INTERVIEW ID 0 - 

Q3 . CONTACT DATE 


house person round 


Q4. INTERVIEWER ID 


MONTH 


DAY 


YEAR 


Q 5 _ TYPE OF SELECTION HOUSEHOLD 

' 2 ! S^O^ELECTION [USE SUPPLEMENTARY SELECTION INSTRUCTIONS] 

3 . REPEATED INTERVIEW ■ 


Hello. I am (first & last na ^aQ ~es and problems of living in different areas to 
opinion survey about the advai ?* ag ®® f J on £ e ntally satisfactory neighborhoods. We 
help in maintaining and crea g i sp o ns0 red by the National Aeronautics 

would like ^.g?t yo^Jl ewa * o^^snSTERl SoS are not required to 

and Space Administration. [SHOW NASA LETT ^ j ^ jt ±s important that we talk 

participate, but it will ry household is one of a small number that has 

to different types of people and J°" r be summarized so that the answers 

been selected from (City) _; or anvone in your household. Your name 

you provide cannot be associated wi Y ^nrordance with the Privacy Act and will 
Ld Address will be held in confldence in regulations. 

S^dV^'^ STS it should tahe about a half 

hour? 


TIME START: 


1. AM 

2, PM 
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ASK ONLY ONCE PER HOUSEHOLD (RECORD ALL CONTACTS ON OTHER SIDE) 

a. F jf rst we need to know the number of adults that i<? ,o 

who presently live in your home. Startina P P }-* 18 or °ver, 

youngest, and then females olSit to JoilnLsf ? ldeS * t0 

their names, just their relationship to you. f £i ST ALL SlS??0NSHIPS°?n 

CONTINUE E SURVEY T WITH T R E study r using kish table, circle the r below, 

ALL PERSONS 1 8 OR OVER WHO SPEAK ENGLISH 

Rank 1 

°fj e f. of A. Relationship B SEX 

Adults f 0 ld«t 


A. Relationship 
(oldest male 
1 

youngest female) 

B. SEX 
(2. Male, 
1. Female) 

1. 

2.M l.F 

2 • 

2.M l.F 

3. 

2.M l.F 

4. 

2 .M l.F 

5. 

2.M l.F 

6 . 

2.M l.F 

7. 

2.M l.F 


—ALL PERSONS UNDER 1 8 OR NON-ENGL ISH SPEAKING ADULTS 

A. Relationship B. SEX 



1 . 

Female) 

1 . 

2.M 

l.F 

2. 

2 .M 

l.F 

3 • 

2.M 

l.F 

4. 

2 .M 

l.F 

5. 

2.M 

l.F 

6. 

2.M 

l.F 

7. 

2.M 

l.F 


I WITHIN-HOUSEHOLD SELECTION 

Kish 1 adult in 2 i 

Number household in 


2 adults 
in 

household 


3 adults 
in 

household 


4 adults 
in 

household 



5 adults 
in 

household 


6 + adults 
in 

household 



Q7. 


s 

you like most about living around here? 


08 How about any things that are disadvantages. What are the one or two things 

° thatyou dislike the most about living around here? 
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09 . 


home . 8 °f "ther^have c^^t^- * h “ y ° U have b -n at 

tell me about the way it is y nova5aJs? han9eS ^ th * n ° ise around here ' P^ase 

home? (PROBE ONCE^ Anythin^elJS?? ^M^^OL^on** around here at 
K u • ^ 9 ej - se7 J [MARK VOL' FOR VOLUNTEERED NOISES1 

noises ^av^changed^ecently^please^ate^h A ~ RESPONDENT ] lf any 

since the change: Y ' please rate the noise the way it is now. 

When you are here at home, does the noise fm™ , 

road traffic) . . .bother, disturb or arm™ from •••( cars or trucks or other 
slightly, or not at all? ' ann °y you extremely, very, moderately, 

[STOPMJ, COMPLETE ENTIRE LIST WITH b BEFORE STARTING c] 

S *“ A ™ 0IED - » »1 

when you are here at home?* *‘- (Cars ° r trucks other road traffic)..! 


± 'i 

I / T , T 

t L J 


a. 

What are 
some of the 
different 
types of 
noises you 
hear around 
here at 
home? 

( PROBE 
ONCE: 
Anything 
else? ) 


When you are here at home, does 

the noise from (cars or trucks 

or other road traffic) .. .bother, 
disturb, or annoy you extremely, 
very, moderated, slightly, or not 
at all? 


Cars or 
trucks or 
other road 
traffic 




Motorcycles 


iii . Railway 
trains 


iv. Aircraft 



1 VOL. 

2 NOT VOL. 


EXTR 

EMEL 

Y 

(1) 

VERY 

(2) 

EXT 

1 

VERY 

2 

EXT 

I 

VERY 

2 





[ASK FOR ALL 
NOISES NOT 
VOLUNTEERED IN 
a WITH "NOT AT 
ALL ANNOYED" 

IN b] Do you 
ever hear 
noise from . . . 

( cars or 
trucks or 
other road 

traffic) 

when you are 
here at home? 



1 YES 

2 NO 
8 DK 


DK 1 YES 
8 2 NO 

8 DK 


1 YES 

2 NO [MARK X 
AT Q15] 

8 DK 


v. [DESCRIBE 
OTHER 

VOLUNTEERED 
NOISES]. IF 
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Q10. 


Here is a n«w scale ,H M C C^BTO SSS. - 2£T 
scale for how much the noises we not at all annoyed, choose zero; if 

you when you are here at ho “f* t J n “ if you are somewhere in between, choose 

a^untoe^betwen^ zero°and ' ou S are ’ botheredf 

disturbed? t or U annoyed°by Z the noise in general when you are here at home? 

i I I 



00 
NOT AT 
ALL ANNOYED 


09 10 

EXTREMELY 
ANNOYED 


Qll. 


bothe'ad^i^'tbld^cr'lnno^fby £?UT£%a" °thL road 

traffic? 


00 01 
NOT AT 
ALL ANNOYED 


09 10 

EXTREMELY 

ANNOYED 



TIME 
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"* Underat * nd th “' «• » Ol-H. .t {this-airport> (tWohange). 


IF MENTIONED AIRCRAFT IN Q13 

F^^^tha^what^o^/er^Tefer^Lng" 


NO -*-» 


DID NOT MENTION AIRCRAFT IN Q13 
H 

Before^ t od a y, did you know about 
that change {time-change} , or 
did you not know about that 
change? 


1. KNEW 
1 


2 . NOT KNOW 

f SKIP TO 0151 


c. aav. you ever heard or learned anything about this change from p 
A newspaper article i I - _ 9 om# **? 


—A newspaper article 

TV 

Radio 

Neigh bor or acquaintance 

^Seeing work on it 

Public meeting 
Somewhere else (Where? 


1 YES 

2 NO 

1 YES 

2 NO 

1 YES 

2 NO 

1 YES 

2 NO 

1 YES 

2 NO 

1 YES 

2 NO 

1 YES 

2 NO 


8 DON'T RECALL 
8 DON'T RECALL 
8 DON ' T RECALL 
8 DON'T RECALL 
8 DON f T RECALL 
8 DON ' T RECALL 
8 DON 'T RECALL 


1 • FAVOR 

2 . OPPOSE 

3. NO OPINION 

0. DID NOT KUCW ABOUT IT AT THE TIME/HEW RESIDEMT ( VOLUHTEERED ) 
** {change-only}? r read * nythi " 9 * bOUt h °“ decision „ae eade to 


1 • YES 

2 • NO [ SKIP TO q . I 

1 I 

f. In your opinion, was the process II 

that was used to decide whether V 

o {change-only} a fair process? || 

1. YES 

2. NO 

8. DON'T KNOW/UNSURE 

9 ‘ change e ^time-change}? SSUeS ° r Concerns that have related to the 


1. YES 

I 

What types of issues or 
concerns? 


2 • NO [ SKIP TO NEXT Q ] 
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would you say that the aircraft noise her. increased, decreased, or stayed 
about the same after {change-only2} {time-only} 

1 . INCREASED 

2 . DECREASED 

l: DON'T KNOW BECAUSE IS A NEW NESIDENT, 


«-"X" if did not hear aircraft in Q9, 7.c.iv 
Ul ASK Q16UU 


So nowadays after {change-only2>, how 
often have you heard airplanes whenyou 
are here around home: often, sometim ' 
o”y occasionally, or have you never heard 

an airplane? 

1 . OFTEN 

2 . SOMETIMES 

•a ONLY OCCASIONALLY _ 

4*. NEVER [MARK BOX AI Q37 , SKIP TO Q22] 


SKIP TO Q17 IF BOX NOT MARKED 
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Q17 .A a* 


Considering <ti„.-only 2 >, heve the eircr.ft ever ...(startled you).., 

[ASK ALL ITEMS BEFORE ASKING b] 

2T«itS 1 ° »nd tell me 

very much, moderately, a littli, or not at all annoyed? “*** Y ° U £eels 


4 ' l 
4 ' T 
ZL' I 

a. And still considering {time- 
only2), have the aircraft ever 
• • • ( startled you ) . . ? 


Startled you 


ii. Woke you up 


a. OCCUR Jb. When they have ..(startled 

I you)-, how annoyed does this 
I make you feel: very much, 

| moderately, a little, or not 
_ at all annoyed ? 


VERY 

MUCH 

<i) 



A NOT AT DK 
LITTLE ALL 

<«) ( 8 ) 


1 YES 1 

2 NO l 


11 YES J 



VERY 

1 


MODER I LITTLE 


c< ? nsic *ering {time-only}, 

S[i£*^I^ stening_ to__ radio or TV) » . . . 

iii* Interfered with listening to 
radio or TV 


f 2 NO | 


have the aircraft ever 


( interfered 


1 YES I 


1 2 NO 1 

■ |3 NA I 

iv. Made the TV picture flicker |l yes 1 


VERY 

1 


MODER IxiTTLE 


NOT 

DK 

4 

8 


v. Made the house/apartment 
vibrate or shake 


vi. Interfered with conversation 


vii. Interfered with or disturbed 
any other activity r IF ’ YES ’ 
SPECIFY ALL, MARK MOST 
ANNOYING, AND ASK b OF 
MOST ANNOYING] 


|2 NO 1 
*3 NA J 


1 YES 1 


‘2 NO l 


1 YES I 

2 NO I 


YES 1 
2 NO 1 



VERY 

1 

MODER 

2 

LITTLE 

3 

j NOT 
4 

DK 

8 



MODER I LITTLE 


NOT 

DK 

4 

8 

















































Q18 .A 


Q19 


Here are some other ways airplanes at home nowadays do you ever 

considering <time-only2} , w ^njou are n 
notice ...(fumes or smells from aircratt,/ 


[ASK ALL ITEMS BEFORE ASKING bj 


Please looX at the how°a^oyed D 5oes' this make you 

When you notice ...( READ IT little , or not at all annoyed? 

feel: very much, moderately, a ntcxe, 


a. OCCUR 


♦ r 2. 

|a. Still considering {time- 

only2>, when you are here at 
home nowadays do you ever 
notice ...(fumes or smells 
from aircraft)?. 

Fumes or smells from aircraft |l YES l 


b. When you notice (READ ITEM 

FROM GRID)., how annoyed does 
this make you feel: very 
much, moderately, a little, 
or n ot at all annoyed?, 

I I I _ 


[ii" - "oust or dirt from aircraft 


|iii. Lights from the aircraft at 
night 

|iv. Any noise from the aircraft 
when they are sitting on th e 
around running their engines 
or m oving around the ^airport^ 

Anything else from the 
aircraft [IF ’ YES ' SPECIFY 
ALL, MARK MOST ANNOYING, AND 
ASK b OF MOST ANNOYING] 


2 NO it 

1 YES I 

2 NO * 

1 YES 1 

2 NO t 
1 YES 1 


VERY 

MUCH 

(i) 


MODER- 

ATELY 

( 2 ) 


A 

little 

( 3 ) 


little 



NOT AT 
ALL 

( 4 ) 


2 NO l 


VERY MODER LITTLE I NOT 
1 2 3 14 


VERY MODER 1 LITTLE NOT 
1 2 I 3 I 4 


hen you hear the aircraft fly overhead nowadays, do you ever feel there i= 
ny danger they might crash nearby? 

2. NO [SKIP TO NEXT Q] 

. YES 1 * 3 

5— hi verY often, moderately often, or only 

a. Would you say you feel tnis ry 
occasionally? 

1 . VERY OFTEN 

2 . MODERATELY OFTEN 

3 . ONLY OCCASIONALLY 
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1 • VERY OFTEN 


1. 

2 . 

3. 

4. 


VERY OFTEN 
MODERATELY OFTEN 
ONLY OCCASIONALLY 
NEVER 


Q21. a. Do you think ...(the pilots fivinn , 

aircraft noise around here if thSy wantUd^tJ ? * * ' ' could reduce the 

[ASK ALL ITEMS BEFORE ASKING b] 

pilots £w4 t tS i JlS2, tB, " e SS C) : r ch d ° think ...(the 

if they vented to, “very Lj] “rT^Tj 


la. REDUCE 


Do you think ...(the pilots 
rlymg the planes) — could 
reduce the aircraft noise 
around here if they wanted to? 


The pilots flying the planes 


|ii. The people who run the 
airline companies 

liii. The officials who run the 
■ aarport 


Local government officials 


HOW MUCH 

fr?ina C Jh d ° ?° U think *•(«»• Pilots | 
flying the planes) ..could reduce 

the aircraft noise around here if 
they wanted to: very much, 

little ? rably ' moderate ly' a 


VERY 

MUCH 


CONSIDER- 

ABLY 

MODER- 

ATELY 

A 

LITTLE 

2 

3 

4 




2 

3 I 

4 1 

mmm 

Wm& 

2 

3 I 

4 T 



2 

3 r 

4 1 

lillilig 

1 


DK 
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Next we have some questions about your 


decision to live here. 


, / tf ALWAYS. CHECK BOX FOR ALWAYS) 

q 22 . When did you move to this house/apartment? (IF ALWAYS, 

0R □ LIVED HERE ALWAYS [SKIP TO Q24] 


/ 

MONTH /YEAR 


Q23. Back when you first decided to move here, did you expect there woul 
aircraft noise here? 

8. NOT REMEMBER 

[SKIP TO NEXT Q] 


2. NO, DIDN’T 
EXPECT NOISE 


1. YES, EXPECTED 
AIRCRAFT NOISE 

1 1 

la. Has the aircraft noise turned out to be more, 
as what you expected? 

unDC 4 . 


|b . Is it a lot more or a 
little more than what 
you expected? 

1. A LOT MORE 

2. A LITTLE MORE 

3 . DON'T KNOW 


ABOUT THE SAME 

I 

[SKIP TO NEXT Q] 


less, or about the same 
LESS 


1 c. Is 

it a lot less or a 

1 little less than what | 

you 

expected? 

5. 

A LOT LESS 

6. 

A LITTLE LESS 

7 . 

DON'T KNOW 
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Q25 . 


“> st - as (this - 



TIME 
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Q 26 . 


Next we need your opinion about how the aircraft noise^as been aroun^home 

the noraing ». 

[REPEAT A-F FOR EACH ??“* lesTtHmT l^HI^E^AS 1 SEPARATE EPISODES 

AROUND HOME] 



What time did 
you then go 
back indoors 
or leave the 
area? 

I 

RECORD IN 
"TIKE END” 

BOX, START NEW 
episode 


B. YES 


C. NO 

I 


f. What time of 

RECORD 

day was that? 
1 

RECORD in "TIME 

CURRENT TIME 

IN "TIME END" 

BOX, SKIP TO 

end" box, start 

NEW EPISODE 

Q27 
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[DO 

Q27 


Q28 . 


Q29. 


Q30 * 


HOT ASK Q27 IF AWAY FROM HOME AT 6 AM] 

Were you asleep at 6:00 this morning? 

NO [SKIP TO NEXT QUESTION] 



Did you try to take a nap or 5l eep at any tin* ter, at hone today. 



BEGIN: 
BEGIN : 


1. AM END: 

2. PM 

1. AM END: 

2. PM 


1. AM 

2. PM 

1 .AM 

2 .PM 



Do you currently have double glazinc 
windows on your home that could help 


storm windows or any other special 
to keep some of the noise out? 


1. YES 

2. NO 

8. DON'T KNOW 


Have you left your door or any windows open in your hone today? 



2 . MOSTLY OPEN 

3 . MOSTLY CLOSED 
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heard any noise from 


Q31. 


Next, we are going to rate the noise today, 
aircraft when you were here at home today. 


Have you 
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Q32. 


- •«!. from -z.ro- to 

means they were "extremely noisy-. On this -x«o- L ij n “ sy Ind "ten" 

have the aircraft been here at S home today? " ZSr °" t0 " ten " SCale ' h ° W nois y 


00 01 02 03 04 
not at 
ALL NOISY 


05 


06 


07 08 09 10 

EXTREMELY 

NOISY 


Now we want to compare your rating of 
other days . 


{INSERT NUMBER FROM Q32 ) for today to some 


Q33. a. 


to day ? nie ~ 0nl Y ^ ' h * 8 therS been a da * that was noisier for aircraft than 



How would you rate that noisiest day for aircraft on a 
soele where "sere- is "not ,t all niisy- a^ "en' L 
extremely noisy ? 1S 

J 1 111 I I I I I I 

Sot a? 1 °5 06 07 08 09 10 

ALL NOISY EXTREMELY 

NOISY 

^ " V ° I -' raTEE1<E[> «« «* A HEW RESIDENT 

w “ th “* ^ that was noisier for 

1. YES 



Howjouid you rate that day for aircraft noise from "zero" to 
1 


SSt AT 01 55 53 “ *5 06 07 k fe 10 

ALL NOISY EXTREMELY 

NOISY 
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Q34. 


pi ease look at this card 
••■«* drippin9 

faucet) . * . ? 

(a dripping faucet to be extremely, very. 


moaeratcxj / «■ 

Extreme- 

Very 

Moderate- 
ly — 

A little 

4 

4 

Not at 
all 

5 

DON'T 1 
KNOVJ 

8 

a. A dripping faucet 

b. A dog barking 

1 

1 

2 

2 

3 

3 

5 

8 

c. The sound of a knife 

_ ^ — -A— • O FS 1 A LC 

1 

2 

3 

4 

5 

8 

d* Someone whistling 

1 ] 

2 

3 

4 1 2 3 

5 

8 

e . Someone switching on 

the radio when you 
want to be quiet 

1 

2 

3 

3 

4 

4 

5 

5 

8 

8 


1 

1 

2 

2 

4 

5 

8 


Q35. Would you say you are more sensitive or 
noise? 

morf 4. ABOUT THE SAME 

M j (VOLUNTEERED) 


less sensitive than other people to 

LESS 


a. Would you say you are 
a lot more or a little 
more sensitive? 

1. A LOT MORE 

2. A LITTLE MORE 

3. DON'T KNOW 


[SKIP TO NEXT 

Q] 


Would you say you are a 
lot less or a little less 

sensitive? 

5 . A LOT LESS 

6 . A LITTLE LESS 

7. DON'T KNOW 


141 - 



Q36. 


Have you done something about the aircraft , 

airport, writing an official, signing a Detition' SU< ^ h tele P honin 9 the 
something else to complain about the aircraft nSise? 109 “ meetin 5' done 

1 . 


YES 

1 


2. NO 


a. What have you done? (DO NOT 

READ; CIRCLE ALL THAT APPLY) 

lb. Have you ever felt like doing | 

1 something? I 

1. PHONED THE AIRPORT 

2. WROTE A LETTER 

3. SIGNED A PETITION 

4. WENT TO A MEETING (SPECIFY 
TYPE OF MEETING) : 

1. YES 

2. NO 


5. OTHER (SPECIFY): 

c. Do you know who residents should 1 
contact if they have a complaint? 1 


1 . YES 2 

1 

NO 


(SKIP TO NEXT 

Q] 


d. Who is that? 



TIME 
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□ 


«-"X" IF NEVER HEAR AIRCRAFT IN Q16, SKIP TO Q41 


^■"X" if "not at all ann_QYed^_JjL-22,L,,Z,i^ 


,iv 


SKIP TO NEXT QUESTION IF 
EITHER BOX IS BLANK 


*-"X M if "not at all annoyed” or volunteered "DO NOT 
HEAR” in 012 


IF 

X 

X 


IF BOTH BOXES ARE ”X" 
m ASK Q37 1111 


III — 

037. You said earlier that the aircraft noise does not 
actually annoy you personally, but we did not ask 
you if you thought it was a good or a bad feature 
of the area. Considering the strong and weak points 
of living here, would you say that hearing aircraft 
is a disadvantage of living here, or an advantage 
of living here? 


1. DISADVANTAGE 

2 . ADVANTAGE 

3 . NEITHER ( VOLUNTEERED ) 


[SKIP TO Q41 ] 
[SKIP TO Q41 ] 
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Here is a practice card for a comparison question [HAND CARD E TO RESPONDENT] The 
first line is the baseline, which has a score of 100. Use this first line to ’rate 
the length of the other lines. The longer another line is, the higher the score you 
give it. For example, if a line is about twice as long as the baseline, you would 
score it 200. If it is a quarter as long, you would score it 25. Don't worry about 
being too exact. We only need your general impression. 

Q38. Compared to the baseline with a score of 100, what score would you give to line 
(...A..)? 


[ "How about line (...)?"] 


IF RESPONDENT DOES NOT GIVE NUMBERS LESS THAN 100 FOR LINE A OR GREATER 
THAN 100 FOR LINE B, THEN GIVE SOME COACHING ON THESE LINES. IF THE 
RESPONDENT STILL CANNOT CHOOSE LARGER OR SMALLER NUMBERS THAN 100 AND SEEMS 
TO BE UNCOMFORTABLE, THEN MARK THE 'NOT COMPLETED’ BOX, THANK FOR 
COOPERATION AND MOVE TO NEXT QUESTION. 

POSSIBLE COACHING INSTRUCTIONS FOR LINE A: 

"Can I just check to be sure my instructions were clear? Is your line A 
shorter or longer than the baseline. [PAUSE FOR "shorter"]. About how much 
shorter would you say, maybe a half or a third or a quarter? [PAUSE FOR 
ANSWER] So since the baseline is 100, you will want to give a number less 
than 100 to line A. What number would you say is about right for line A?" 


ENTER RESPONDENT'S SCORES IN PARENTHESES AT LEFT: 


Baseline (100) 

A ( ) 

B ( ) 

C ( 

D ( 

E ( 

F ( ) 

G ( ) 

O CHECK HERE IF NOT COMPLETED AND THEN CONTINUE WITH NEXT QUESTION 
That was very good, just what we need. Now for another kind of baseline. 
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Q39. 


„ nf how you feel about aircraft noise 

Now you compare things against a ase 

nowadays around your home. ^ „ Uge the 

This time your feeling about aircraft J^^gJ^e^erything else^ For 

sa.vw*. u 

upper Silt; Sr^5-« that shows how much you are anuoyed. 

S« S ii,S” 8l w“wSiS £.“2 than aircraft norsef 

s SESS X ScS 

so, compared to a score of ^ ^(having a dog next door that 

S$»Sy CTJ middle of the night, ...7 


| SCORE 


'having a dog next door that regularly barks in the 
middle of the night 


|^°^^°*'®^®^^*^^^^^^-°?ess 0 annoying S than aircraft 
■that be more annoy mg or less a y y 

|noise? 

1 MORE ANNOYING THAN AIRCRAFT 

2 . LESS ANNOYING THAN AIRCRAFT 

Lo compared to a score of 100 for the aircraft noise 

Inowadavs , what score would you gi ve to. . - 


ii. 


having a front door that squeaks 


If you do not have some of these things we mention, gust 

aScore of loi for the aircraft noise 
nowadays, what score would_you giv e to. . — 


liii • 


liv. 


'having unhealthy air . the are, , UF 

LESS THAN 100, CHECK HERE "““f 
ftNNOYIHG O P LESS ANNOYING THAN ATRCRAF ) 

'hearing big noisy trucks if you lived at a busy 
intersection 
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( And still compared to a score of 100 for the aircrafr 
2 2^g£_Qggadays, what score wou ld you give to. . 


Iv. 


£our n hc^ 3 " nl ' yard bU8iness that from 


SCORE 


Vi * having a smoke detector that gives a false alarm 
about once a month when someone is cooking 

vii. what if it went off twice a month? 

viii. having a sticky window that's hard to open 


( And still compared to a score of 100 for the aircraft 

*** jEFEZ neighbor with appliances or power tools 
that sometimes make your TV picture flicker 

having a pothole in the street near your home 


h' rlisl vour e vot a n °i Sy ' bUSy hi 9 hwa y that you must 
I raise your voice when you are outside 

Ixii. having mice in your home 


■And still compared to a score of 100 for the aircraft- 
|j£S^^Jg|^g^g^s^gha^^core_jfould_youq^r e to. . 

I xiii ' £«3£l!; b £' a i °£ aide li9ht your 

Ixiv. getting telephone calls at home from salespeople 

M^LnD p^p dSy (IF LESS THAN 100 ' CHECK HERE □ 

aircraft^ IF MORE annoyi ng or le ss annoying than 

whft'ml‘ai^ S K COrapar * th ? aircraft noise nowadays with 
?00 ha ? pen i n the future, compared to a score of 

V°S ^v. to * lrCraft DOiSe “>■« score would 

|XV * JiL a Jf» r ? £t f:!? 0is ? that y ° U ex P ect to hear 

{new- time} after {new-change2} 


□ 


O CHEC K HERE I F NOT C OMPLETED AND THEN CONTINUE WITH NEXT QUESTION 
TIME ' ’ ’ 
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ASK ALL [EVEN IF DO NOT HEAR AIRCRAFT NOISE] 


Q41. 


of the n en?iroLent! ea piML a usi S Ly f nSSbe? t f?i m t "one" S to 0 " the ° V ? ra i 1 qualit > r 

muci: S y oS 0 tiiJk a eaS probl^thr^ten/tS^ovLan 96 11 "^" 

Sh^r^ — an ett; h ;i;i;;:r‘ 


(PROMPT; So, on a scale from "one” 
pollution) . . .threaten the overall 


to "seven" 
quality of 


, how much does 
the environment? 


( air 



Now I have a few last background questions [ASK ALL] 


Do 

you regularly read .... 

.? [READ LIST] 

a. 

{Paper 1} 

1 YES 

b. 

{Paper 2} 

1 YES 

c. 

{Paper 3} 

1 YES 

d* 

{Paper 4} 

1 YES 

e. 

Another local newspaper 
(SPECIFY: 

1 YES 


2 NO 
2 NO 
2 NO 
2 NO 
2 NO 


Q43. Do you regularly read . . . .? [READ LIST] 

a. Any newsletter from {this-airport} 

b. Any newsletter for your local neighborhood 


2 NO 
2 NO 
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Q44 . 


Do you regularly 


watch local TV news programming? 


Q45 . 


Q46 . 


Q47 . 


Q48 


Q49 


1. YES 

2. NO 


Do you or anyone else in your household work at an 
does business there? 


airport or for a company that 


1. YES 

2. NO 


This next question is about l/SSSSgh* F^iSyr^^oTSn^u^rLwSSk ? 

the week. On the average Monday througn rrx y, 

are you away from your home? 


HOURS /WEEK 


w • military or worked for one of the military services? 

Have you ever been m the milita y 


1. YES [SKIP TO NEXT QUESTION] 


2. NO 

J 


la Has anyone else living here ever been 

in the military or worked for one of 
the military services? 

1. YES 


What is your date of birth? 


MONTH DAY 


YEAR 


DO you own your home or are you renting? 

1. OWN (Include owing a mortgage) 

2 . RENTING 
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Q50 . 


Do you have 
months? 


any plans to move away from this 


hou s e / apartment 


in the next 12 


2. NO [SKIP TO NEXT Q] 



Q51 . 


Have any of your neighbors 
this questionnaire? 


or acquaintances and you ever talked together about 


1. YES 

2. NO 


Q52. 


What is the highest education level you have completed- 


2 . 


4. 


EIGHTH GRADE OR LESS 
9TH TO 11TH GRADE 
12TH GRADE (HIGH SCHOOL GRADUATE) 

i I YEARS (S0ME COLLEGE, BUSINESS, TRADE SCHOOT 1 

16 YEARS (COLLEGE-UNIVERSITY GRADUATE) 

17 YEARS+ (SOME GRADUATE WORK) 

refused' DOCTORAL ' OR PROFESSIONAL degree 


That is the end of the interview. Your answers have been very helpful. 


Q53. 


can an^er&^r" T»jSSSS)S“ dkcumVohT 1°/™” * 
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Would you mind giving me your 


Q54. 


My supervisors verify some of my ^® rvieWS 
telephone number so they can do that? 


1. YES (TELEPHONE NUMBER: ( ) 

2. NO [SKIP TO Q57] 


Q55. 


Who should they 
CIRCLE "Mrs." or 


^ i I OBTAIN FIRST AND LAST NAME. 

a -His? Sl? S'JoSSSd bv'respondeht.) 


Mr. 

NAME: Mrs. 

Miss 


q56. (CONFIRM MAILING ADDRESS IF UNKNOWN) 

Street or P.0, Box: 


Q57. 


City, State, Zip: — 

woal d if be an bi g bb to teiepbone you bacb fob a few Rations if we need «. 

YES - THANK RESPONDENT ^OR COOPERATION RESPONDENT UNDERSTANDS 

H [IF INITIALLY SEEMS TO REFUSE ^ ^ , 


*rwF REQUEST. 


[THANK RESPONDENT] 


time END^ 


- 151 - 


bSSL T ?L F Sx? W otbS AFTER C0BCL0DIliG ™is interview red before 

Q58. SEX OF RESPONDENT 

1. MALE 

2 . FEMALE 

Q59. DID THE RESPONDENT'S HEARING CAPACITY SEEM TO BE: 


1. NORMAL 


2 . MODERATELY DIMINISHED 

J 


3 . SEVERELY DIMINISHED 


[IF DIMINISHED] DESCRIBE EXTENT OF PROBLEM 


INTERVIEWING METHOD 

1 . FACE-TO-FACE 

2 . TELEPHONE 


TYPE OF DWELLING 

1. MOBILE HOME, TRAILER 

2 . SINGLE DWELLING UNIT STRUCTURE 

3 . MULTIPLE DWELLING UNIT STRUCTURE 

4. OTHER (DESCRIBE) 


Q62. RACE (BY OBSERVATION ONLY) 

1. WHITE 

2. BLACK 

3. AMERICAN INDIAN 

4. OTHER (DESCRIBE) 

Q63. HOW GOOD WAS THE RESPONDENT'S UNDERSTANDING OF THE QUESTIONS? 

1. ABOUT AVERAGE OR BETTER THAN AVERAGE 

2. SOMEWHAT WORSE THAN AVERAGE 

3. MUCH WORSE THAN AVERAGE 

Q64. IS THERE ANYTHING ELSE THAT SHOULD BE CONSIDERED WHEN CALLING BACK? 

1. YES (DESCRIBE) 

2. NO . 
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PHRASES TO USE IF COMPIAIjL^BOUT^_REPETITIOUS_^UESTIONS^ 


E^So^all^f^he questions are slightly different, I know a few of them can 
gimilar for people in special circumstances like yourself . When any seem 
““tUSis fo? y?u? P just\i?= me a quick .newer .„d we will move ri ght .long to 

other cruestions . ■■ """ 


^““.S^Sone may be a bit repetitious for you. However, they 
were all really carefully selected and are all somewhat different. Perhaps you 
^S!d like ?o know why we need to ask all of them. There is one mam reason. 

To make your answers about noise really useful, we have to compare your answers to 
the^nsw^s that other people in others studies gave about their areas noises. 

The problem is that each of these other studies used slightly different J£5s and 
Some asked about day and some about night. Some showed people lists of words 

some a scale of numbers . 

we have to ask you each of those slightly different questions to be sure that your 
opinion will coLt in a comparison with each of the other studies. If any more of 
the questions seem repetitious to you, just give me a quick answer and I 11 g 
right on. — 
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H.2 Show cards 


The cards on the following pages are shown to respondents at the places where their use is prompted in 
the text of the questionnaire. 
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H.3 Experimental questionnaire pages 

The next two pages are the alternative version of two pages that are 
form surveys to test two question forms. 


to be used in half of the long 
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ALTERNATIVE QUESTION format (Q39B) 


Q39B Over 6,000 people in the iinii-oH 0 +-=* 

question to tell us about the aircraft n«T an ^ red this next 
the past week . While you’ve been a 1 - h 1Se at their homes in 
just since last 7? day? ZLiT? home over the past weekT^ 

all annoyed by aircraft noise sliaht?^ ^hat you've been not at 
noise, moderately ?nno^e2 by ai?c«^^ LtT^ by aircraft 
aircraft noise, or ^^,2^ by 


1. NOT AT ALL ANNOYED 
2 • SLIGHTLY ANNOYED 

3. MODERATELY ANNOYED 

4. VERY ANNOYED 

5 . EXTREMELY ANNOYED 
8 . DON ’ T KNOW 



%g^e252££<8L!2&\. >*» «- - (startled 

you ) • . ? 

[IF YES, ASK b IMMEDIATELY BEFORE GOING ON TO NEXT ITEM] 
b. Please look at the AMOUNT CARD [HAND CARD GTO ^PONDENT] ^nd 

2S Uttle, or not ,t aU 

annoyed? 


a. OCCUR 


And still considering {time— 
only2>, have the aircraft 
ever . . . ( startled you ) . . ? 


Startled you 


ii. Woke you up 


, . When they have ..(startled 
you)., how annoyed does this 
make you feel: very much, 
moderately, a little, or not 

at all annoyed? 

VERY MODER- A I NOT AT I DK 
MUCH ATELY LITTLE ALL 


-> i VERY MODER LITTLE NOT DK 

1 YES ! 1 2 3 4 18 



-x i VERY MODER LITTLE NOT DK 
1 YES i 2 3 48 


I -N ! VERY MODER I LITTLE NOT DK 

iii . Interfered with listening U yES J j 2 2 | 3 | 4 I 8 

to radio or TV 1 — 1 


iv. Made the TV picture 
flicker 


Made the house /apartment 
vibrate or shake 


Interfered with 
conversation 


Interfered with or 
disturbed any other 
activity [IF 'YES' 
SPECIFY ALL, MARK MOST 
ANNOYING, AND ASK b OF 
MOST ANNOYING] 



O i VERY MODER LITTLE NOT 

! 1 2 3 


2 NO 




I ^ x < VERY MODER LITTLE I NOT 

1 YES -J | 3 2 3 I 4 




MODER 

2 

little 

3 

NOT 

4 

DK 

8 


YES Z) 


VERY MODER LITTLE NOT DK 

1 2 3 4 8 


























APPENDIX I: SOCIAL SURVEY QUESTIONNAIRE (SHORT FORM) 

This appendix contains the short form of the questionnaire that is designed for administration via 
telephone This questionnaire is for use only after the noise change. It provides data at additional 
pomes m teme to supplement the long-form questionnaire that is administered at about 11 months 
after the noise change. Almost all of these questions are also included in the long form of the 

— a ' re e '! ' n ,)n “ ary resp0nse measuremenl section (Long Form Q 6 to Q.8) or in 

the one-day evaluation section (Long Form Q.25 to Q.32). ; 

forn T thiS a PP endix must be adapted to the local airport and noise change 
conditions by replacing keywords that appear in braces The keywords are listed with the 
actual words (within quotes) that were used in the Dallas pretest. 

, ( Z"!' C !: an8 1r d ' SCriP ' i0n ° f recenl chan 8 e (e g-, “opening a new parallel runway”} 
{recent-change2} = descnptton of recent change {e.g„ “the new runway opened} 

{short time-only} = date of recent change {e.g., “Monday, June 30"} 

The short interview form begins on the next page. 
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OMB APPROVAL 


NO. 


2120-0621 

Expires: 10/31/2000 


SHORT FORM — TELEPHONE INTERVIEW 
VERSION 1 


COMPLETE THE FOLLOWING ITEMS BEFOEE BEGINNING THE INTERVIEW. 

Ql. INTERVIEW ID — 

Q2. CONTACT DATE 


house person round 



Hello. I « ( f l r "l thi a Sva^ » iRd‘probieL. B o£ 1 Uvinrin‘3i;i;«nL areas 
opinion survey about the | environmentally satisfactory 

iSTw^S lr.ge » -re, in your household who had the 
most recent birthday. Would that be you? 


1 . 
2 . 


YES 

NO 


iSfS’oF ELIGIBLE ADULT J ASK TO SPEAK WITH HIM/HER OR 
SCHEDULE CALLBACK; REPEAT INTRODUCTION] 


(You are not required to J^diff^rent type^of^eople Ind^our household 
xt is important that we talk, to j ■f'rnm fCitvl • Our results 

is one of a small number -^^answers you provide cannot be associated with 
will be summarized so that the ans !J name and address will be held in 

conf idence°in the ‘wo^yof hS. 

?^oi £ toTniw: d n vs- — 15 “ ° r lessn 


TIME START: 



1. AM 

2. PM 


Q4. 


When did you move to this 
ALWAYS ) 

/ OR 

“month Tyear 


house/apartment? (IF ALWAYS, 
□ LIVED HERE ALWAYS 


CHECK BOX FOR 
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Q5. 


t'.rK StiirSboS -ifborhood right around your ho*e, 

two things you ‘ *” the “ 


Q6 . 


How about any things that are disadvantages. 
a y° u the most about living aroun< 


What are the 
here? 


one or two things 
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x.-s*s: 

tell me about the way it is nowadays. 

e. what are sow. o£ the different types * 

home? (PROBE ONCE: Anything else?) [MARK voia puk 

NOISES] 

. Next I'd like to ask you to rate the noises around here. If any noises 
b - llll changed* recent Ly^ pleas, rate the noise the way it is now, since the 

change . 

when vnn are here at home, does the noise from (cars or trucks or 

othe/road traf fic) .. .bother, disturb, or annoy you extremely, very, 
moderately, slightly, or not at all? 

[ STOP 1 ! ! t COMPLETE ENTIRE LIST WITH b BEFORE STARTING c] 

_ r ASK FOR ALL NOISES NOT VOLUNTEERED IN a WITH "NOT AT ALL ANNOYED" IN b] 
{.o Jou evS hear noise from ...(cars or trucks or other road traffic)... 
when you are here at home? 


a be 

1 A A 

I'T'J 

1' I' I 


a. 

What are 
some of the 
different 
types of 
noises you 
hear around 
here at 
home? 

( PROBE 
ONCE: 
Anything 
else? ) 


i. Cars or trucks 1 VOL . 

or other road 2 NOT VOL. 
traffic 


ii. Motorcycles 1 VOL. 

2 NOT VOL. 


iii . Railway 
trains 


iv. Aircraft 


[ DESCRIBE 
OTHER 

VOLUNTEERED 
NOISES]. IF 
'VOL', SPECIFY 
ALL, MARK MOST 
ANNOYING, ASK 
b OF MOST 
ANNOYING . 


1 VOL. 

2 NOT VOL. 


1 VOL. 

2 NOT VOL. 


When you are here at home, does 
the noise from ...(cars or trucks 
or other road traffic) . . .bother, 
disturb, or annoy you extremely, 
very, moderately, slightly, or not 
at all? 


MODE SLIG 

rate htly 
LY (4) 
(3) 


EXT VERY MOD SLIG 
12 3 4 


EXT VERY MOD SLIG 
12 3 4 


EXT VERY MOD SLIG 
12 3 4 


EXT VERY MOD SLIG 
12 3 4 



[ASK FOR ALL 
NOISES NOT 
VOLUNTEERED IN 
a WITH "NOT AT 
ALL ANNOYED" IN 
b] Do you ever 
hear noise from 
. . . ( cars or 
trucks or other 
road 

traffic) . . . 
when you are 
here at home? 
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Q8. Next we need your opinion about how any noises have been around home today 
from six in the morning until now. But, before we ask about the noises, we 
need to know when you might have been around to hear the noises. 

[REPEAT A-F FOR EACH EPISODE. RECORD FIRST EPISODE UNDER EPISODE 1. 

1. DO NOT RECORD EVENTS OF LESS THAN 10 MINUTES AS SEPARATE EPISODES 

2. COUNT TIME SPENT AT NEARBY NEIGHBORS — WITHIN 3 HOUSES — AS TIME 
AROUND HOME] 


F 

So at ...(6:00).,. were you . . . ? 



1. AWAY FROM HOME 

A 

. AROUND HOME 


L_ 

i 


1 



b. What time did you 





get back home? 
1 

c. Were you indoors or outdoors at 

. . . (6:00) ? 


RECORD IN "TIME END" 

2 . OUTDOORS 

3 . INDOORS 



BOX, START NEW EPISODE 

1 

1 



d. What time 

e . Did you go outdoors or leave 


did you then 

home (again) later in the 


go back 

day? 



indoors or 

B. YES 

C. NO 


leave the 

J 

i 


area? 




1 

f . What time of 

RECORD CURRENT 


RECORD IN 

day was that? 

TIME IN "TIME 


"TIME END" 

i 

END" BOX, 


BOX, START 

RECORD IN "TIME 

SKIP TO Q9 


NEW EPISODE 

END" BOX, START 




NEW EPISODE 



EPISOD 

E 

TIME BEGIN 

AWAY FROM 
HOME 

AROUND HOME 

TIME END 

OUTDOORS 

INDOORS 

( Indicate AM or 
PM) 

1 

0 6:0 0 AM 

1. AWAY [DO 
NOT ASK Q9] 

2. OUTDOORS 

3 . INDOORS 

AM/PM 



1 *AWAY ' ;■ 

^|^i^ddRS ; 

3. INDOORS VT 

__ »•-» 

3 

• 

1. AWAY 

2. OUTDOORS 

3 . INDOORS 

: AM/PM 


* 

X. away ..| 

QRS 

3. INDOORS f§ 

im &j»/PM 

5 

* 

1. AWAY 

2 . OUTDOORS 

3 . INDOORS 

: AM/PM 

H, • 

HU :1 

1. AWAY 

2 .OUTDOORS 

! 3i. INDOORS |f 


7 

• 

1. AWAY 

2 . OUTDOORS 

3 . INDOORS 

: AM/PM 

mill 

$ 

M ***** 


3 . INDOORS : : :i 

. im « imii ni| AM/RK : 

9 

• 

1. AWAY 

2. OUTDOORS 

3 . INDOORS 

:_ AM/PM 



■ 1* AWAY • 

:fl®D00Ri; 

3 l INDOORS f 

J _AH/|>K " 
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(DO NOT ASK Q9 IF AWAY FROM HOME AT 6 AM) 

Q9. Were you asleep at 6:00 this morning? 



Q10 • 


Did you try to take a nap or sleep at any time here at home today? 



ou - SLS a c =rySr\^%s« b =ouii a s«;?'tr^ P “™nf o thrnoise" u ?r c 


1. YES 
2- NO 

8. DON'T KNOW 
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Q12. 


Q13. 


Have you left your door or any windows open in your home today? 


YES, OPEN 

1 


1. NO, CLOSED [SKIP TO NEXT QUESTION] 


a. 


*44 WUW 


closed most of the time? 


have the doors or windows been open or 


2. MOSTLY OPEN 

3 . MOSTLY CLOSED 


Next, we are going to rate the noise today, 
aircraft when you were here at home today ? 


Have you heard any noise from 


1. 


YES 

I 


2. NO [SKIP TO Q16] 


a. 


here at home today, how much did the noise from 
sUgiSy, or 'oi rttu,' ° r ann0y very, moderately. 


1 . 

2 . 

3 . 

4 . 

5. 


EXTREMELY 

VERY 

MODERATELY 
SLIGHTLY 
NOT AT ALL 
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Q14. 


Next we have a "zero" to "ten* ^j 0 ^*** ?oday"f ^hoose 

« ^£*Zr'A\^ S |»M ■£•? - y 

were ^^here r^between^ choos^_ ^ have the airC raft been here at home 
today? 



00 
NOT AT 
ALL NOISY 


10 

EXTREMELY 

NOISY 


Now we want to compare your rating of 
some other days • 


(INSERT NUMBER FROM Q14) for today to 


Q15. a. 


Since .~-.„n-ch,nce> Ishort ti m e-onlyl. there been a day that was 

noisier for aircraft than today? 


scale°where°"zero* S*’nSf 

"extremely noisy"? 



Before ( r-hancel fshort time-onlyl, — there ever a day that 

was noisier for aircraft than today? 



HOW would you rate that day for aircraft noise from "zero" to 
"ten"? 
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Q 16 . 


We understand {recent-change2> on 
you know about this change? 


{short time-only}. 


1. YES 

2 . NO 


Before we talked, did 


Q17 . 


What changes in the 
{recent-change 2 } on 


aircraft noise, if any, have you noticed since 
{short time-only}? (PROBE TO GET SPECIFIC CHANGE) 


Now I have one background question. 

018. In what year were you born? 

19 

live y °' ,r « =*» tell ho„ far 


019 - sms ™ is agrees bi ™ ““»■ «■> 


1. YES 

2. NO - 


(CORRECT STREET NAME 


Q20. I just want to check: is 
the closest street next to you? 

1. YES 

2 . NO -* ( CORRECT CLOSEST STREET 

Thafa all the questions that I have. I'd like to thank you for your time, 


TIME END 
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COMPLETE THE FOLLOWING ITEMS AFTER CONCLUDING THIS INTERVIEW AND BEFORE 
BEGINNING THE NEXT INTERVIEW 

Q21. SEX OF RESPONDENT 

1. MALE 

2 . FEMALE 


Q22. 


DID THE RESPONDENT'S HEARING CAPACITY SEEM TO BE: 

3 SEVERELY DIMINISHED 

- o unnTTRnTKi. y ^ „ 

1. NORMAL 


Q23. INTERVIEWING METHOD 

1 . FACE-TO-FACE 

2 . TELEPHONE 


Q24. 


HOW GOOD WAS THE RESPONDENT'S UNDERSTANDING OF THE QUESTIONS? 

1. ABOUT AVERAGE OR BETTER THAN AVERAGE 

2. SOMEWHAT WORSE THAN AVERAGE 
1. MUCH WORSE THAN AVERAGE 



APPENDIX J: QUESTIONNAIRE NOTES 


The purposes for including each of the questions has been explained in the text of this report where the 
questions were identified by their question numbers. This section contains some additional information 
about some questions where the choice of the wording was guided by specific considerations beyond 
the obvious ones of meeting study objectives, being clear to respondents, and reducing the possibilities 
of non-sampling error. These specific considerations usually relate to the decision to repeat a question 
from a previous questionnaire for the purpose of strengthening comparisons with the previous study’s 
results. In other cases a previous study’s question was used only because it had been found to be 
satisfactory in that study. In either case, a review of the previous study’s results may aid in interpreting 
and planning the analysis for a noise change survey. F “ 


Q. 8 & Q.l 1 These are the two primary aircraft noise response questions. The questions are worded 
to conform with the recommendations of the Community Response Team (Team 6) of 
the International Commission on the Biological Effects of Noise). The justification for 

the wording of the questions has been reported in considerable detail (Fields 1996b- 
Fields, et al., 1998). 


Q.9 

Q.16A 

Q,18 

Q.22 


The term “cars, trucks or other road traffic” has been used in the sonic boom study 
(USA-375) and in several British road traffic surveys (UKD-) 

This 11 -point question about general noise sources s primarily a training question before 
the more important road traffic and aircraft questions. 

This set of activity disturbance items has been used in many aircraft surveys in Britain 
including the first Heathrow surveys in the 1960's. 

This question on fear from aircraft was first used in the 1967 Heathrow survey. 

A somewhat similar question about moving expectations was asked in an Australian 
aircraft survey (AUL-210). 


0*25 - Q.30 and all of short, telephone questionnaire about the day-of-interview reactions 

The form of all of these questions and the exact wording of many of the questions was 

used in a repeated-interview study of helicopter noise (Fields and Powell 1985- Fields 
and Powell, 1987) 


These noise-sensitivity items have been used in several surveys (UKD-008, UKD-024). 
This version has five points rather than the two (yes/no) points that were used in 
previous surveys. 


This overall noise-sensitivity judgment question has been used in several surveys (UKD- 
072, UKD-148). For the noise change questionnaire the follow-up questions “a” and 
“b” were used to expand the number of points on the scale. 


This question and some of the previous questions that are filters for it are included to 
support the magnitude estimation questions that appear later. The question is needed to 
determine if the respondent has any negative reactions because the magnitude estimation 
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question can 


only be used if there are negative reactions to aircraft noise. 


Q.37 and Q38 These are somewhat modified, by Fields 

that were used in a previous sonic boom surv y ( 


Q/39A 

Q.39B 

Q.40 


(1996a). 

,hat is analyzed in ,his report ' 


This ftve point scaie is the same as was 

changes in aircraft noise exposure in Burbank California (USA 7US). 
time period matches the question that was used m that survey. 

This question about environmental issues comes from a .^ 55 ^ Ave' oLtridge, 

administered by Cambridge Report/Research ““earn ' as £5»1 and (in a 
MA 02139. The question was used in several different years, as 

possibly different context) 1992. 
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APPENDIX K: INTERVIEWER INSTRUCTIONS 
The interviewer instructions for both the lone form and shm* 

in this appendix. These instructions provide* basis for some ofZs !t ,H ques "° nna,res ate Presented 
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Interviewer Instructions - Long Form 


Contact Sheet, Household Information (Ql-4), and the Introduction 

You will be provided with a cover sheet that contains the household ID number and 
Complete address. On this con, no, sheet, you wil, record the date, time, nnd outcome of 

every contact with the household. 

Fill in Ouestions 1-4 according to the information on the contact sheet. The household ID 
nl^rscSand should be completed immediate, y. The remainder of thts box can be 

completed later. 

Introduction • Interviewers can exercise discretion in the order in which they present the 
Introduction. Intervm^ ^ the However , do NO T mention no.se or a.rports 

in the introduction. The phrases you should emphasize are. 

► ‘National Aeronautics and Space Administration’ 

► ‘Your name and address will be held in confidence’ 


Refusals: If the respondent attempts to refuse: 

► Don’t be apologetic or feel like you are intruding. This is a very 
important study. 

► Trv to engage the respondent in conversation , 

Hand the respondent the letter from NASA and say "today obv.ously 
is not a good day. I’ll come back later after you have had a chance to 

read this letter" 

If the respondent absolutely refuses after you had made the above attempts: 

. Record the exact reason(s) for the refusal. We will be trying to 
convert the refusals and need as much information as possible. 

T . . Ri{? ht justify the time; do NOT use military time, check AM or PM. There 

are several other places throughout the interview where you will also record 

the time. 
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Q5-Sampling an Eligible Adult 


Fnc^ k'tk 6 f ° r tC , StU ^’ 3 res P° ndent must be 18 years old or more and must speak 
English. The sampled adult must be selected using the respondent selection scheme in 

random manner' 8 Sampl ‘ ng scheme Wl11 enable y° u to select an adult from the household in a 


After the introduction, the interviewer begins by determining all respondents 
who meet the sample criteria (in this case 18 years old or more and English 
speaking) who live in the household. 

* Starting with the oldest male, record all males 18 years old or more. 

Repeat the process above for all females in the household, starting with the 

oldest female in the household. Again, the criteria is 18 years old or more and 
English speaking. 

*• If there is a reason to be uncertain, ask if everyone speaks English. 

- Assign a number to all the eligible adults as follows: the oldest male is 

assigned 1, next oldest male (if there is one) numbered 2, and so forth through 
2ii males listed. Continue numbering with the oldest female, next oldest 
female, and so on. 

For example, consider a household with a husband, wife, an adult son, an 
adult daughter, and the wife’s father. Here, the assigned numbers would be: 1) 
the wife’s father, 2) the husband, 3) the adult son, 4) the wife, and 5) the 
adult daughter. 

* After y° u have listed and numbered all the adults from oldest male to 

youngest female, sum the number of eligible adults. Use the table on the 
contact sheet to select the appropriate respondent. Table 1 below shows the 
Mi selection table- only the row matching the Kish number for that 
household will appear on your contact sheet. 

Using the same example noted above (5 adults), let’s say the within household 
selection Kish number El appears on the contact sheet for that household In 
this case, you would ask to speak with adult number 3 (the adult son). Circle 
number 3 to indicate this is the person you interviewed 
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Interviewer Instructions 


Table 1: WITHIN-HOUSEHOLD SELECTION 

3 adults in 
household 


Kish 

Number 


Q6 


Q7 


1 adult in 
household 


2 adults in 
household 


4 adults in 
household 


5 adults in 
household 


6 + adults in 
household 



In this question, as well as all others, always stress underlined words. 

The word neighborhood should be used for all locations. 

,f respondent does no. volunteer a. leas, two items liked, use the single simple 
probe ("What else?"). Only probe once. 

If respondent does no. volunteer at least two items disliked, use the single 
simple probe ("What else?"). Only probe once. 

forte respondent at the present moment. The Rues, ton aUo a lows 
respondents to feel that their strongest feelings tew .been ecot*i 

Respondents should not, however, be encouraged to promde detads that^ 

be asked about again later. If they start to do so, tell them you II ask m 
ahnnt that later. 


CARDS 


Question 8b is 
very important 
is being used. 


he first time the response cards are to be used. NOTE. It is 
hat interviewers keep all cards at their side except when 
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Q8 


cfr^ R^d 1 alMh^lf' ' “? ^ "* ’’“P 0 "*"' *> no. able to see .he 

If d H h alternatlve answers for at *^1 the first three checklist items 
there is a digression or any discussion between items on the checklist be 

a " a ““ a8 ™' »“<• -ponden. hesi.a.es, retd 1 

Th.s is .he first grid where careful attention must be directed at the order of 
asktng the ttemstn the questions. Ask Q8a fits,. Probe for a^SLe 

lev^MMh"^ d marked as “ VOL ” m ,he HEAR “1“™- If 

: l r ,S “ r men,io " ed in <**■ *»" an the noises. Then 

an^oyLg note! S '” 8 m ° S ' ann ° yi " g “°" Kr ” and circle lhal “* 

^k'ngtsc 8 ° 8a ’ ' 1S indiCa ‘ ed ^ ' he arr ° W ’ read thC en,ire list in Q8b EMI •■> 

Repeat 08b in full when you get to part iv "aircraft”. This is one of the most 
important questions in the survey. If the respondent answers “not at all” to 
aircraft mark an “X” jus, before 036. I. is critical that you mark these 
“I" ,nS,rUC ' ed “ d0 SO ' as ,he y wil1 help you later in the survey to 
and ke<fp S |t 'u ntiTneedtfd ** *" " k “ d “ ° 8b 

If the respondent says “no” to “aircraft” in Q8c, mark an “X” a, Q15 It is 
critical that you mark these boxes when instructed to do so, as they will help 
you later in the survey to possibly skip questions. ^ 

Hand Card B to the respondent. Please note that these are critical questions. 

Continue to use Card B. Note that if the respondent is not a. all annoyed by the 

tse from aircraft when they are here around home or they volunteer that thev 
do not hear aircraft, you should mark an “X” at Q36. ^ 

Record verbatim all noises that have changed in 012a. Probe to be sure what 

Z !h ! ' S § menti ° ned - Do not > how ever, probe for so many details 
that the next question is awkward. The next question (Question 13 and 

Question 13a) needs to be asked of everyone to be sure that they are referring 
to the same noise source. ® 

Q13a, Q13b If “aircraft" was mentioned in Q12 and you have probed to ensure that the 

change is what we expect given the sampled airport, ask Q13a If aircraft was 
no. mentioned in 012 or ihey don', know if any noi^s have chaj" 


Q9-10 

Q11 

Q12 


Q13d 


This question should be asked of all respondents, regardless of how long they 
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I mtfr vtf.wer Instructions 


Q13h 

Q14 

Q15 

Q16 


Q17 


Q20 

Q21 

Q23 


have lived there since new residents could have known about the change even 
when living at another location. 

Record issues/concerns verbatim. Probe for clari8cation if needed. 

If a respondent doesn't know the answer because they are a new resident, 
check don’t know. 

If the box is checked indicating that they did not hear aircraft in QSc.iv, ask 
Q15. Otherwise, proceed to Q16. 

There are two versions of 016 (Q16A and Q16B). Please note the different 
pattern for asking parts “a.” and 'V for Q 16 A and Q16B (the pattern var 
depending upon the version of the survey you have.) 

For Q16A, ask about all the items in “a” before asking part 'V' of the question. 
For Q16B, ask parts “a" and “b" for each item, prior to movmg on th 

item. 

If respondent is a new resident, the time frame should be “since you moved 
here”. 

• ,„fnn mi 7 A and 017B). Please note the different 
depending upon the version of the survey you ave.) 

For Q17A, ask about all the items in “a” before asking part “b” of the question 
For Q17B, ask parts “a" and “b” for each item, prior to movmg on to the 

item. 

Ask Q20a for all items prior to asking Q20b. 

,f they don't recall the month, probe with “what time of year was .ha,'' to try 
to help them remember. A time of year is better than nothing at all. 

Record in detail the new changes they have heard about. 
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This one ° f ; several P' aces “ * he taerview where an interviewer may want to 
use the preemptive warning that they may be asking a question that the 
respondent has already answered, but that they must ask everyone at this point. 
When answering the question, i, is very important that respondents focus on 
he planned change that we are informing them about in this question (rather 
than responding to their volunteered change mentioned in Q23). 

If there are more than 10 episodes, carefully record all extra episodes on a 
separate sheet. The skip patterns in this question can be difficult if you are not 
familiar with all possible combinations of skips. However, this question has 
teen successfully used in other studies. Thus, it is important that you practice 
the skip patterns with all possible sequences of answers until it becomes 

natural. Respondents will not have any trouble answering the question if you 
are clear with your skips. y 

Do not ask Q26 if they were away from their home at 6 AM. 

If the respondent has tried to take a nap or sleep more than 3 times that day 
record the beginning and ending time of the additional times below the grid.’ 

The windows did not have to be installed solely to keep the noise out. We just 
want to know if they have these types of windows. 

Emphasize that we are talking about today’s aircraft noise when they have 
been at home. Circle their rating, and record it in the blank below question 31. 

Note that you do not ask parts “c” and “d” if they have earlier volunteered that 
they are a new resident since the change. 

If the respondent does not know what the word “grating” is, you can say 
grinding . 3 


not 


We do not want detailed information about past complaint actions and do 

orTh^NAQA tha ‘ WC W ° Uld takC any aCti ° n W ' th rCSpeCt to their ^mplaints 
hat NASA is an appropriate place to make complaints. If the respondent 

wants to know what they should do, say “I really don’t know”. 

If the respondent says they went to a meeting, probe for type of meeting. 
CAUTION: Note differences in SKIP instructions. 

E If there is an X in the first box, skip to Q40 

□ If there is an X in the second and third box, ask Q36. By checking the 
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Interviewer Instructions 


two boxes we know that there were two instances where the 
respondent said they were not bothered or annoyed or did not hear 
aircraft noise. We want to confirm this with one final annoyance 
question (Q36), before deciding whether to skip the whole section, or 
to continue on with the line exercise. 

□ If there is only one X in the second or third box, skip to Q37 


Q37 Right justify the answers. If the respondent cannot complete Q37, check the 

circle at the bottom of Q37 and skip to Q38. 

Q38 Everyone is asked the magnitude estimation questions even if they could not 

perform the line-length exercise in Q37. 

Right justify the answers. Read the probes in the grids as written. For numbers 
larger than the spaces provided, record the answer in the margin. 

Prompt respondents to reconsider their answers if the answers to “i”, “ii”, and 
“in” are not consistent. Probe to see if more or less annoying than aircraft. 

If the respondent cannot answer this question, place a check mark at the end of 
the question and continue with the next question. 

Q39 Note there are two versions of this question, each with a different type of 

scale. Q39A uses a 7 point scale of definitely satisfactory to definitely 
unsatisfactory, while Q39B uses a 5 point scale of not at all annoyed to 
extremely annoyed. 

Q40 If the respondent asks “Do you mean nationally or locally”, say “It’s what it 

means to you”. 

Q41, Q42 If the respondent says they only occasionally or sometimes read the newspaper 
or the newsletter, record their answer as “no”. 
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Q45 Note that this is asking for the total amount of time away from home on 

Monday through Friday. 

Q49 This question specifically asks about plans to move. Thus, if they are only 

considering moving or have given it only casual thought, they should answer 
“no”. 

Q53 It is all right if the respondent gives a work number. Simply note that it is a 

work number. 

Thank you Interviewers may paraphrase the proceeding thank you and explanation if they 
want to. 

Last page Complete the last page about the respondent and residence characteristics 

immediately after the interview. Describe in detail any unusual circumstances 
occurring during the interview, or any cautions we should use in a follow-up 
interview. 

Complaints Become very familiar with these responses to complaints of the survey being 
too repetitious. These responses are found at the end of the survey. They are 
classified by degree of objection to the survey. 
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I NTER VIEWER INSTRUCTIONS 


Interviewer Instructions — Short Form 


Household Information (Ql-3), and the Introduction 


Introduction: Interviewers can exercise discretion in the order in which they present the 

information in the introduction. However, do NOT mention noise or airports 
in the introduction. The phrases you should emphasize are: 

► ‘National Aeronautics and Space Administration’ 

► ‘Your name and address will be held in confidence’ 


Refusals : If the respondent attempts to refuse: 

► Don’t be apologetic or feel like you are intruding. This is a very 
important study. 

► Try to engage the respondent in conversation 

► Say “today obviously is not a good day. I’ll call you back at a more 

convenient time” 

If the respondent absolutely refuses after you had made the above attempts: 

► Record the exact reason(s) for the refusal. We will be trying to convert 
the refusals and need as much information as possible. 

Time: Right justify the time; do NOT use military time, check AM or PM. There are 

several other places throughout the interview where you will also record the 

time. 
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Sampling an Eligible Adult 

To be eligible for the study, a respondent must be 18 years old or more and must speak 
English. We want to speak with an English speaking adult, 18 years old or more, who had the 
most recent birthday. This sampling scheme will enable you to select an adult from the 
household in a random manner. 

Q4 If they don’t recall the month, probe with “what time of year was that” to try 

to help them remember. A time of year is better than nothing at all. 

Q5 In this question, as well as all others, always stress underlined words. 

The word neighborhood should be used for all locations. 

If respondent does not volunteer at least two items liked, use the single simple 
probe ("What else?"). Only probe once. 


Q6 If respondent does not volunteer at least two items disliked, use the single 

simple probe ("What else?"). Only probe once. 

Although an attempt should always be made to record responses verbatim, it is 
especially important that the phrases which are used to describe environmental 
nuisances are recorded verbatim for this question . (If the respondent is 
speaking too fast, then mention that you have to write it all down and don’t 
want to miss anything they said.) This question is useful for determining 
whether aircraft noise change is a highly salient, current, and important issue 
for the respondent at the present moment. The question also allows 
respondents to feel that their strongest feelings have been recorded. 
Respondents should not, however, be encouraged to provide details that will 
be asked about again later. If they start to do so, tell them you’ll ask more 
about that later. 

Q7 Ask Q7a first. Probe for a second response. These responses should be 

marked as “VOL.” in the HEAR column. If several “other” noises are 
mentioned in Q7a, write down all the noises. Then ask Q7b about the single 
most annoying “other” noise, and circle that most annoying noise. 

After asking Q7a, as indicated by the arrow, read the entire list, in Q7b prior to 
asking Q7c. Repeat Q7b in full for the first four items (through “aircraft”). 


Q8 If there are more than 10 episodes, carefully record all extra episodes on a 

separate sheet. The skip patterns in this question can be difficult if you are not 
familiar with all possible combinations of skips. However, this question has 
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been successfully used in other studies. Thus, it is important that you practice 
the skip patterns with all possible sequences of answers until it becomes 
natural. Respondents will not have any trouble answering the question if you 
are clear with your skips. 


Do not ask Q9 if they were away from their home at 6 AM. 

If the respondent has tried to take a nap or sleep more than 3 times that day, 
record the beginning and ending time of the additional times below the grid. 

The windows did not have to be installed solely to keep the noise out. We just 
want to know if they have these types of windows. 


Q14 

Q15 

Q20 


Emphasize that we are talking about today’s aircraft noise when they have 
been at home. Circle their rating, and record it in the blank below question 14. 

Note that you do not ask parts “c” and “d” if they have earlier volunteered that 
they are a new resident since the change* 

The objective of this question and question 19 is to pinpoint the exact location 
of their home. In Q20, respondents may want to give you the name of a major 
road that is the crossroad. We do NOT want the major road, unless it is really 
the closest crossroad to them. 


Thank you Inteiviewers may paraphrase the proceeding thank you and explanation if they 
want to. 


Last page 


Complete the last page about the respondent immediately after the interview. 
Describe in detail any unusual circumstances occurring during the interview, or 
any cautions we should use in a follow-up interview. 


Complaints 


Become very familiar with these responses to complaints of the survey being 
too repetitious. These responses are found at the end of the survey. They are 
classified by degree of objection to the survey. 
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